Jun 11 19:19:47.779880 ip-10-0-139-23 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 19:19:47.779896 ip-10-0-139-23 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 19:19:47.779907 ip-10-0-139-23 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 19:19:47.780296 ip-10-0-139-23 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 19:19:57.976460 ip-10-0-139-23 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 19:19:57.976479 ip-10-0-139-23 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c8a22aa046d142c883890900893a7174 -- Jun 11 19:22:46.553630 ip-10-0-139-23 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:22:46.940898 ip-10-0-139-23 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:46.940898 ip-10-0-139-23 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:22:46.940898 ip-10-0-139-23 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:46.940898 ip-10-0-139-23 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:22:46.940898 ip-10-0-139-23 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:46.941528 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.940912 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:22:46.945195 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945179 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.945195 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945193 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.945195 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945197 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945200 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945203 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945205 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945208 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945210 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945213 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945217 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945219 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945222 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945225 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945228 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945232 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945235 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945238 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945241 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945244 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945247 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945250 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945252 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.945283 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945255 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945257 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945260 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945262 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945264 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945267 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945270 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945272 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945274 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945278 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945280 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945283 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945285 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945288 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945291 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945293 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945296 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945299 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945301 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.945755 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945303 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945306 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945308 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945311 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945313 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945317 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945320 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945324 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945326 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945329 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945331 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945334 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945336 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945339 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945341 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945345 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945362 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945364 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945367 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945370 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.946215 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945372 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945375 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945377 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945383 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945386 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945390 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945393 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945396 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945400 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945402 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945405 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945407 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945410 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945413 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945416 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945419 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945421 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945424 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.946709 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945426 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945430 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945432 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945435 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945437 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945440 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945443 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945445 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945448 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945451 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945454 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945456 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945459 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945461 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945463 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945466 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945468 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945471 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.945474 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946127 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.947162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946133 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946137 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946141 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946145 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946148 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946151 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946154 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946157 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946160 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946162 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946165 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946168 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946172 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946174 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946177 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946180 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946182 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946185 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946188 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.947660 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946190 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946193 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946197 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946200 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946202 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946205 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946208 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946211 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946213 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946216 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946218 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946221 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946224 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946227 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946230 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946232 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946235 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946238 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946241 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.948112 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946243 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946246 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946248 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946251 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946253 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946256 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946258 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946261 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946263 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946266 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946268 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946271 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946274 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946277 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946279 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946282 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946284 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946287 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946289 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946291 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.948584 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946294 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946297 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946299 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946302 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946304 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946307 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946310 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946312 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946315 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946317 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946320 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946322 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946325 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946327 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946331 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946338 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946342 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946344 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946363 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.949086 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946366 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946368 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946371 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946374 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946376 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946379 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946381 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946384 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946386 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946389 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946391 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946393 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946396 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946398 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946401 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946403 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946406 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946408 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946411 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946414 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.949565 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946416 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946748 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946753 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946756 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946759 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946761 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946764 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946767 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946771 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946774 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946777 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946779 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946782 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946785 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946787 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946790 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946792 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946794 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946797 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946800 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.950077 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946802 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946805 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946807 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946810 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946812 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946815 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946817 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946820 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946822 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946825 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946827 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946830 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946834 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946839 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946843 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946845 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946848 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946851 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946854 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946856 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.950581 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946860 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946862 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946866 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946870 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946872 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946875 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946878 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946882 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946884 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946887 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946889 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946892 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946894 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946897 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946899 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946902 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946904 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946907 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946909 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.951093 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946912 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946914 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946917 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946920 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946922 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946925 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946929 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946932 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946935 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946939 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946942 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946944 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946947 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946950 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946953 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946955 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946958 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946960 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946963 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.951570 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946965 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946968 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946970 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946973 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946975 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946977 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946980 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946982 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946985 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946987 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946990 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946992 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946997 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.946999 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947001 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947004 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947006 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947009 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947013 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.952037 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947016 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947018 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947095 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947110 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947120 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947127 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947133 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947136 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947140 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947143 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947146 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947149 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947152 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947155 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947158 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947161 2577 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947164 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947167 2577 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947170 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947172 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947176 2577 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947179 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947181 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947184 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:22:46.952550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947187 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947191 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947193 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947196 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947199 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947202 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947205 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947212 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947216 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947219 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947223 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947226 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947228 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947231 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947235 2577 flags.go:64] FLAG: --enable-server="true" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947237 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947248 2577 flags.go:64] FLAG: --event-burst="100" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947251 2577 flags.go:64] FLAG: --event-qps="50" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947254 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947256 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947259 2577 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947266 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947269 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947272 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947274 2577 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:22:46.953123 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947277 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947280 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947282 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947285 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947288 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947290 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947293 2577 flags.go:64] FLAG: --feature-gates="" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947296 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947299 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947302 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947304 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947307 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947310 2577 flags.go:64] FLAG: --help="false" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947313 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-139-23.ec2.internal" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947316 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947320 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947323 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947326 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947329 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947332 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947334 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947337 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947340 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:22:46.953772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947343 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947346 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947362 2577 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947365 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947368 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947371 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947373 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947376 2577 flags.go:64] FLAG: --lock-file="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947378 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947382 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947384 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947389 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947392 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947395 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947397 2577 flags.go:64] FLAG: --logging-format="text" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947400 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947403 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947406 2577 flags.go:64] FLAG: --manifest-url="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947408 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947412 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947415 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947419 2577 flags.go:64] FLAG: --max-pods="110" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947421 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947425 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947428 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:22:46.954364 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947431 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947434 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947437 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947440 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947447 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947450 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947453 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947456 2577 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947459 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947463 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947466 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947469 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947472 2577 flags.go:64] FLAG: --port="10250" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947474 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947477 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-013bbc2439d078a22" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947480 2577 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947483 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947485 2577 flags.go:64] FLAG: --register-node="true" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947488 2577 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947491 2577 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947494 2577 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947497 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947502 2577 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947505 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947508 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:22:46.954985 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947511 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947513 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947516 2577 flags.go:64] FLAG: --runonce="false" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947519 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947521 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947525 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947528 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947531 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947533 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947537 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947539 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947542 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947545 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947547 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947550 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947553 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947555 2577 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947558 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947563 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947565 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947568 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947571 2577 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947574 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947576 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947589 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:22:46.955600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947592 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947595 2577 flags.go:64] FLAG: --v="2" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947599 2577 flags.go:64] FLAG: --version="false" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947603 2577 flags.go:64] FLAG: --vmodule="" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947606 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.947609 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947733 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947737 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947740 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947743 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947745 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947748 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947751 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947753 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947756 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947759 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947761 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947764 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947767 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947769 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947773 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.956241 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947776 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947778 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947782 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947785 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947789 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947791 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947794 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947797 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947799 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947802 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947804 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947807 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947809 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947812 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947814 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947817 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947819 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947821 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947824 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.956764 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947826 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947829 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947831 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947834 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947837 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947840 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947843 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947845 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947848 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947850 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947853 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947855 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947859 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947861 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947864 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947866 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947869 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947871 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947874 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947876 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.957233 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947879 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947881 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947885 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947888 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947891 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947894 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947897 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947899 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947902 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947905 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947907 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947910 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947912 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947915 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947917 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947920 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947922 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947925 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947928 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.957778 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947930 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947932 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947935 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947937 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947940 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947944 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947946 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947948 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947951 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947953 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947956 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947958 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947961 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947963 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947967 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947970 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947973 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947976 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947979 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947982 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.958552 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947984 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947987 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947990 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947992 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947994 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.947996 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.948734 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.955441 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.955549 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.955567 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.955576 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955650 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955655 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955658 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955661 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.959072 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955664 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955673 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955676 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955679 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955681 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955684 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955686 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955688 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955691 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955694 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955696 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955699 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955701 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955703 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955706 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955708 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955711 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955713 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955716 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955719 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.959468 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955723 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955726 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955728 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955731 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955734 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955736 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955739 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955741 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955744 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955746 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955749 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955751 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955753 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955755 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955763 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955766 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955769 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955771 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955774 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.959943 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955776 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955780 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955783 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955787 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955790 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955792 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955795 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955798 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955800 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955803 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955805 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955808 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955810 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955813 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955815 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955817 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955821 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955824 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955827 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.960422 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955830 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955832 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955835 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955837 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955840 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955842 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955845 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955847 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955850 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955858 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955861 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955864 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955866 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955868 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955871 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955873 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955876 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955878 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955881 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955883 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.960886 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955886 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955888 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955890 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955893 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955895 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955897 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955900 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955902 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955905 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955907 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955909 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955912 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955914 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955916 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955919 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955921 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.961430 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.955923 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.955928 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956068 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956073 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956075 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956078 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956086 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956089 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956091 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956093 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956096 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956098 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956101 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956103 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956106 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:46.961815 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956108 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956111 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956113 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956116 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956118 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956120 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956123 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956125 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956128 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956130 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956133 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956135 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956138 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956140 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956143 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956145 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956147 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956150 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956152 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956154 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:46.962180 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956158 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956161 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956164 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956167 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956174 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956177 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956179 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956182 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956184 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956187 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956189 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956191 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956194 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956196 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956199 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956201 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956204 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956206 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956208 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956210 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:46.962687 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956213 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956215 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956218 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956220 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956224 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956226 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956229 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956231 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956234 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956236 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956239 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956242 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956250 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956252 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956255 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956257 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956260 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956267 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956270 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:46.963172 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956275 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956277 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956280 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956282 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956285 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956287 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956290 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956292 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956295 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956297 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956299 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956303 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956306 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956310 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956313 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956316 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956318 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956322 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956324 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:46.963752 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956327 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956330 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956332 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956335 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956337 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956340 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956342 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:46.956345 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.956365 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.956474 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.959733 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.961088 2577 server.go:1019] "Starting client certificate rotation" Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.961195 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:22:46.964220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.961226 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:22:46.964569 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.963462 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:22:46.967198 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.967184 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:22:46.976698 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.976683 2577 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:22:46.980835 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.980821 2577 log.go:25] "Validated CRI v1 image API" Jun 11 19:22:46.981771 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.981743 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:22:46.985100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.985083 2577 fs.go:135] Filesystem UUIDs: map[576b5ec6-3acb-482f-9c2d-9adb3fd77436:/dev/nvme0n1p3 65b6bec2-a33e-4765-8204-3b32ee470e00:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 11 19:22:46.985151 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.985100 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:22:46.990476 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.990368 2577 manager.go:216] Machine: {Timestamp:2026-06-11 19:22:46.989008255 +0000 UTC m=+0.323061510 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096406 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2825ab662c825364d053c2206fd314 SystemUUID:ec2825ab-662c-8253-64d0-53c2206fd314 BootID:c8a22aa0-46d1-42c8-8389-0900893a7174 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:06:d7:98:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:06:d7:98:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:8e:7a:ee:b7:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:22:46.990476 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.990475 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:22:46.990602 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.990591 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:22:46.993074 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.993041 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:22:46.993202 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.993077 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:22:46.993670 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.993660 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:22:46.993713 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.993673 2577 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:22:46.993713 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.993685 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:22:46.994074 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.994061 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:22:46.994283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.994271 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:22:46.995472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.995462 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:22:46.998277 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998265 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:22:46.998410 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998400 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:22:46.998446 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998430 2577 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:22:46.998446 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998442 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:22:46.998502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998460 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:22:46.998502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998481 2577 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:22:46.998554 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.998507 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:22:46.999302 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.999290 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:22:46.999342 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:46.999310 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:22:47.010606 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.010576 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:22:47.012141 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012123 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:22:47.012205 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012155 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:22:47.012318 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012308 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:22:47.012377 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012323 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:22:47.012377 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012329 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:22:47.012377 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012335 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:22:47.012377 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012343 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:22:47.012377 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012369 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:22:47.012902 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012894 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:22:47.012902 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012902 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:22:47.012961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012909 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:22:47.012961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012915 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:22:47.012961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012923 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:22:47.012961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.012931 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:22:47.013844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.013830 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:22:47.013844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.013844 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:22:47.016767 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.016748 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:22:47.016880 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.016857 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:22:47.016951 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.016857 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 19:22:47.018393 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.018378 2577 server.go:1268] "Started kubelet" Jun 11 19:22:47.018558 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.018538 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nx8jn" Jun 11 19:22:47.018616 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.018539 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:22:47.018616 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.018609 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:22:47.019322 ip-10-0-139-23 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:22:47.019452 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.019328 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:22:47.020692 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.020673 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:22:47.021469 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.021450 2577 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:22:47.024697 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.024674 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:22:47.024790 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.024680 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:22:47.024854 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.024790 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.025339 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025213 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:22:47.025339 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025218 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:22:47.025339 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.025226 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:22:47.025339 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025290 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:22:47.025580 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025435 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:22:47.025580 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025445 2577 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:22:47.025580 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025559 2577 factory.go:55] Registering systemd factory Jun 11 19:22:47.025580 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025574 2577 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:22:47.025772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025758 2577 factory.go:153] Registering CRI-O factory Jun 11 19:22:47.025811 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025774 2577 factory.go:223] Registration of the crio container factory successfully Jun 11 19:22:47.025854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025825 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:22:47.025854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025848 2577 factory.go:103] Registering Raw factory Jun 11 19:22:47.025947 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.025861 2577 manager.go:1196] Started watching for new ooms in manager Jun 11 19:22:47.026189 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.026179 2577 manager.go:349] Starting recovery of all containers Jun 11 19:22:47.029456 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.029436 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nx8jn" Jun 11 19:22:47.036901 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.036882 2577 manager.go:354] Recovery completed Jun 11 19:22:47.041153 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.041122 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 19:22:47.041372 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.041322 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 19:22:47.041372 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.037692 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-23.ec2.internal.18b81d353701415e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-23.ec2.internal,UID:ip-10-0-139-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-23.ec2.internal,},FirstTimestamp:2026-06-11 19:22:47.01833251 +0000 UTC m=+0.352385746,LastTimestamp:2026-06-11 19:22:47.01833251 +0000 UTC m=+0.352385746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-23.ec2.internal,}" Jun 11 19:22:47.041998 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.041917 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 19:22:47.045781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.045769 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.047607 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.047592 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.047665 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.047620 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.047665 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.047630 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.048093 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048080 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:22:47.048133 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048093 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:22:47.048133 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048108 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:22:47.048191 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048133 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.048807 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048792 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.048848 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048820 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.048848 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.048831 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.049365 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.049341 2577 policy_none.go:49] "None policy: Start" Jun 11 19:22:47.049412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.049373 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:22:47.049412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.049388 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:22:47.049510 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.049435 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-23.ec2.internal.18b81d3538bff182 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-23.ec2.internal,UID:ip-10-0-139-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-23.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-23.ec2.internal,},FirstTimestamp:2026-06-11 19:22:47.047606658 +0000 UTC m=+0.381659895,LastTimestamp:2026-06-11 19:22:47.047606658 +0000 UTC m=+0.381659895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-23.ec2.internal,}" Jun 11 19:22:47.050655 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.050643 2577 policy_none.go:47] "Start" Jun 11 19:22:47.085899 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.085885 2577 manager.go:337] "Starting Device Plugin manager" Jun 11 19:22:47.085962 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.085930 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:22:47.085962 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.085939 2577 server.go:87] "Starting device plugin registration server" Jun 11 19:22:47.086173 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.086161 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:22:47.086219 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.086175 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:22:47.086278 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.086258 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:22:47.086376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.086345 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:22:47.086376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.086374 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:22:47.087392 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.087344 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:22:47.087517 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.087411 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.103260 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.103239 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:22:47.108854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.104529 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:22:47.108854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.104566 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:22:47.108854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.104585 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:22:47.108854 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.104655 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:22:47.108854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.106646 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:47.186887 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.186855 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.188988 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.188973 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.189045 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.189004 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.189045 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.189015 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.189045 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.189038 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.198122 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.198078 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.198122 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.198098 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-23.ec2.internal\": node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.205321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.205305 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal"] Jun 11 19:22:47.205401 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.205384 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.206149 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.206131 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.206236 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.206165 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.206236 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.206178 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.207530 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.207518 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.207671 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.207640 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.207725 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.207675 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.208206 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208188 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.208277 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208217 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.208277 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208227 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.208277 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208192 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.208393 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208295 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.208393 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.208310 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.209434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.209418 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.209473 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.209453 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:47.210139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.210123 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:47.210221 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.210155 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:47.210221 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.210168 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:47.212478 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.212459 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.236978 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.236956 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-23.ec2.internal\" not found" node="ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.241335 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.241318 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-23.ec2.internal\" not found" node="ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.312625 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.312590 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.325904 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.325873 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46a3b7e0737b02e9df1ca865f64b4f49-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"46a3b7e0737b02e9df1ca865f64b4f49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.326026 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.325922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.326026 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.325940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.413592 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.413547 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.426832 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426810 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.426936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426831 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.426936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426860 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46a3b7e0737b02e9df1ca865f64b4f49-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"46a3b7e0737b02e9df1ca865f64b4f49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.426936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.427057 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426949 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b9d54605153734652e785861cb7b4835-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal\" (UID: \"b9d54605153734652e785861cb7b4835\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.427057 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.426963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/46a3b7e0737b02e9df1ca865f64b4f49-config\") pod \"kube-apiserver-proxy-ip-10-0-139-23.ec2.internal\" (UID: \"46a3b7e0737b02e9df1ca865f64b4f49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.514263 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.514228 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.538675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.538650 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.544777 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.544755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:47.614955 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.614915 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.715564 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.715534 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.816094 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.816007 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.916682 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:47.916647 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:47.960083 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.960049 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:22:47.960664 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.960205 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:22:47.981074 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:47.980853 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46a3b7e0737b02e9df1ca865f64b4f49.slice/crio-12f3ddb7f5b5134d5af4d05b9e370e92dc1793f5dfef6a0bafb8ad9c05a349e4 WatchSource:0}: Error finding container 12f3ddb7f5b5134d5af4d05b9e370e92dc1793f5dfef6a0bafb8ad9c05a349e4: Status 404 returned error can't find the container with id 12f3ddb7f5b5134d5af4d05b9e370e92dc1793f5dfef6a0bafb8ad9c05a349e4 Jun 11 19:22:47.982242 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:47.982215 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d54605153734652e785861cb7b4835.slice/crio-5929f8a0369517f38646c3ffb5288db012d48b55baf88d40c65006274324fc48 WatchSource:0}: Error finding container 5929f8a0369517f38646c3ffb5288db012d48b55baf88d40c65006274324fc48: Status 404 returned error can't find the container with id 5929f8a0369517f38646c3ffb5288db012d48b55baf88d40c65006274324fc48 Jun 11 19:22:47.987341 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:47.987329 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:22:48.017285 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:48.017262 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:48.043980 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.043954 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:17:47 +0000 UTC" deadline="2027-12-17 21:02:18.025424427 +0000 UTC" Jun 11 19:22:48.043980 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.043977 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13297h39m29.981449666s" Jun 11 19:22:48.108170 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.108097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"b9d54605153734652e785861cb7b4835","Type":"ContainerStarted","Data":"5929f8a0369517f38646c3ffb5288db012d48b55baf88d40c65006274324fc48"} Jun 11 19:22:48.109111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.109092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" event={"ID":"46a3b7e0737b02e9df1ca865f64b4f49","Type":"ContainerStarted","Data":"12f3ddb7f5b5134d5af4d05b9e370e92dc1793f5dfef6a0bafb8ad9c05a349e4"} Jun 11 19:22:48.117325 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:48.117305 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-23.ec2.internal\" not found" Jun 11 19:22:48.120078 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.120063 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:48.189257 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.189238 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:48.225689 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.225665 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" Jun 11 19:22:48.233155 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.233125 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:22:48.234181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.234166 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" Jun 11 19:22:48.242883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.242866 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:22:48.333121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.333097 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:48.934976 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.934945 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:48.998956 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:48.998918 2577 apiserver.go:52] "Watching apiserver" Jun 11 19:22:49.006495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.006468 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:22:49.006886 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.006863 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z","openshift-cluster-node-tuning-operator/tuned-wdppg","openshift-image-registry/node-ca-wnjm5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal","openshift-multus/network-metrics-daemon-ngc75","openshift-network-operator/iptables-alerter-vzx8r","openshift-ovn-kubernetes/ovnkube-node-m5c28","kube-system/global-pull-secret-syncer-rr6dj","kube-system/konnectivity-agent-5fp84","kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal","openshift-dns/node-resolver-wbwgw","openshift-multus/multus-7mq5z","openshift-multus/multus-additional-cni-plugins-r5jv9","openshift-network-diagnostics/network-check-target-gc9hg"] Jun 11 19:22:49.008456 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.008434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.009561 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.009542 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010588 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010651 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hpvbj\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010710 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010651 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010588 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010657 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.010924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.011370 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.011215 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.011737 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.011559 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.011862 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.011846 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ls6xl\"" Jun 11 19:22:49.012078 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.012058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.012654 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.012636 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:22:49.012766 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.012666 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sbgzx\"" Jun 11 19:22:49.012766 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.012739 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.012908 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.012890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.013365 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.013330 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.013456 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.013409 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:49.013952 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.013928 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.013952 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.013931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.014950 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.014066 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jhlz\"" Jun 11 19:22:49.014950 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.014079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:22:49.014950 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.014531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.015988 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.015840 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.016511 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.016495 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.016602 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.016587 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:22:49.016661 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.016599 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kq54f\"" Jun 11 19:22:49.016661 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.016613 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.017560 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.017537 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.017695 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.017665 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwsn5\"" Jun 11 19:22:49.017781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.017544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:22:49.017956 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.017931 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:22:49.018026 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.018003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.018088 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.018064 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:49.018475 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.018443 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:22:49.018550 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.018504 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.018601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.018549 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:22:49.019758 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.019738 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.020914 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.020894 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:49.021015 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.020966 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:22:49.021472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.021452 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:22:49.021570 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.021496 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:22:49.021798 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.021784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kvmvt\"" Jun 11 19:22:49.023188 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.023171 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.025949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.025191 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:22:49.025949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.025374 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.025949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.025405 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhxrp\"" Jun 11 19:22:49.025949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.025910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:22:49.026201 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.026015 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:22:49.026575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.026556 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:22:49.027315 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.027299 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:22:49.027508 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.027486 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8wwmh\"" Jun 11 19:22:49.036570 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-env-overrides\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.036688 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-system-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.036688 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036616 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-bin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.036688 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036670 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:22:49.036837 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036725 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-conf-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.036885 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl4zz\" (UniqueName: \"kubernetes.io/projected/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-kube-api-access-vl4zz\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.036885 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-bin\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.036984 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-daemon-config\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.036984 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.036984 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036944 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-run\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.036984 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-registration-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.036991 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-dbus\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/182f02c3-60ea-499c-889c-94f34fa2c5ae-konnectivity-ca\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-os-release\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.037181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-etc-kubernetes\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037186 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-sys-fs\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56935d44-34a2-4aed-8347-715d6b172d19-hosts-file\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n7w6\" (UniqueName: \"kubernetes.io/projected/187bd590-1842-4700-81bf-0fb8ddc5c883-kube-api-access-4n7w6\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-kubelet\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-multus-certs\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.037383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037368 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cnibin\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037404 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-iptables-alerter-script\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-log-socket\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037468 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-conf\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56935d44-34a2-4aed-8347-715d6b172d19-tmp-dir\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037532 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-var-lib-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-modprobe-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.037601 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/182f02c3-60ea-499c-889c-94f34fa2c5ae-agent-certs\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-host-slash\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-systemd-units\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037697 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-netns\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-etc-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-script-lib\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxlwz\" (UniqueName: \"kubernetes.io/projected/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-kube-api-access-mxlwz\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037819 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-systemd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.037936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysconfig\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-kubernetes\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-tuned\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.037996 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-tmp\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038019 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7q5\" (UniqueName: \"kubernetes.io/projected/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-kube-api-access-rq7q5\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-ovn\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-socket-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038071 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-kubelet-config\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jcd6\" (UniqueName: \"kubernetes.io/projected/8ba4f746-0a84-4e98-bed3-b203699f51a4-kube-api-access-6jcd6\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-kubelet\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-sys\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038181 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-var-lib-kubelet\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-device-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nz65\" (UniqueName: \"kubernetes.io/projected/56935d44-34a2-4aed-8347-715d6b172d19-kube-api-access-7nz65\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh6rr\" (UniqueName: \"kubernetes.io/projected/443d763d-e6c5-40b5-b19a-1fa43077e5a1-kube-api-access-hh6rr\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.038327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-systemd\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-host\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038320 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cni-binary-copy\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/187bd590-1842-4700-81bf-0fb8ddc5c883-serviceca\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-slash\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-netd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cnibin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-k8s-cni-cncf-io\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038559 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-hostroot\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038581 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8vcv\" (UniqueName: \"kubernetes.io/projected/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kube-api-access-f8vcv\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038603 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-system-cni-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2233ae1d-6633-4e90-862b-cba09e833213-ovn-node-metrics-cert\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038646 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-multus\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.038881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/187bd590-1842-4700-81bf-0fb8ddc5c883-host\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-node-log\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038735 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpgt\" (UniqueName: \"kubernetes.io/projected/2233ae1d-6633-4e90-862b-cba09e833213-kube-api-access-jwpgt\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038766 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-socket-dir-parent\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-netns\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-os-release\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-config\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-lib-modules\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.039416 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.038899 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.054876 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.054837 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8l75s" Jun 11 19:22:49.063659 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.063634 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8l75s" Jun 11 19:22:49.140100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.140100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140098 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/182f02c3-60ea-499c-889c-94f34fa2c5ae-agent-certs\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140171 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-host-slash\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-systemd-units\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140226 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-etc-selinux\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-netns\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140284 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-netns\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-systemd-units\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-host-slash\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-etc-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-script-lib\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-etc-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxlwz\" (UniqueName: \"kubernetes.io/projected/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-kube-api-access-mxlwz\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-systemd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysconfig\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-kubernetes\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-tuned\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-tmp\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140616 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140654 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysconfig\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.140883 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140692 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-systemd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.140987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-kubernetes\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141001 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-script-lib\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141076 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7q5\" (UniqueName: \"kubernetes.io/projected/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-kube-api-access-rq7q5\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-ovn\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-socket-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-kubelet-config\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141273 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-run-ovn\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jcd6\" (UniqueName: \"kubernetes.io/projected/8ba4f746-0a84-4e98-bed3-b203699f51a4-kube-api-access-6jcd6\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-kubelet-config\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-socket-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141346 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.141515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-kubelet\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-sys\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141554 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-var-lib-kubelet\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-device-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141719 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nz65\" (UniqueName: \"kubernetes.io/projected/56935d44-34a2-4aed-8347-715d6b172d19-kube-api-access-7nz65\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-kubelet\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141744 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh6rr\" (UniqueName: \"kubernetes.io/projected/443d763d-e6c5-40b5-b19a-1fa43077e5a1-kube-api-access-hh6rr\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141803 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-systemd\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141825 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-host\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141852 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-sys\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141906 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cni-binary-copy\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-var-lib-kubelet\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.141961 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/187bd590-1842-4700-81bf-0fb8ddc5c883-serviceca\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.142092 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.142022 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-slash\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-netd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142197 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cnibin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-k8s-cni-cncf-io\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-hostroot\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8vcv\" (UniqueName: \"kubernetes.io/projected/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kube-api-access-f8vcv\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142335 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-system-cni-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2233ae1d-6633-4e90-862b-cba09e833213-ovn-node-metrics-cert\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142432 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-multus\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/187bd590-1842-4700-81bf-0fb8ddc5c883-host\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142509 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-node-log\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpgt\" (UniqueName: \"kubernetes.io/projected/2233ae1d-6633-4e90-862b-cba09e833213-kube-api-access-jwpgt\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-hostroot\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-socket-dir-parent\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142735 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-device-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.142935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142813 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-systemd\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.142885 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-host\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143002 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143059 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/187bd590-1842-4700-81bf-0fb8ddc5c883-host\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-multus\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143189 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-system-cni-dir\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.143206 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143228 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-netns\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-netd\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.143264 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:49.643244715 +0000 UTC m=+2.977297943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-slash\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-node-log\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143289 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-os-release\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.143321 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:49.643307938 +0000 UTC m=+2.977361163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/187bd590-1842-4700-81bf-0fb8ddc5c883-serviceca\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143380 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cnibin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143402 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-k8s-cni-cncf-io\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.143740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-cni-binary-copy\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143415 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-os-release\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-netns\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-config\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143535 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-socket-dir-parent\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-lib-modules\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143609 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-env-overrides\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-lib-modules\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-system-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-bin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-conf-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl4zz\" (UniqueName: \"kubernetes.io/projected/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-kube-api-access-vl4zz\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-bin\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143878 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-daemon-config\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.144549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-run\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-registration-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-dbus\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.143994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/182f02c3-60ea-499c-889c-94f34fa2c5ae-konnectivity-ca\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144068 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-ovnkube-config\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144111 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2233ae1d-6633-4e90-862b-cba09e833213-env-overrides\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-os-release\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-etc-kubernetes\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144221 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-sys-fs\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56935d44-34a2-4aed-8347-715d6b172d19-hosts-file\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n7w6\" (UniqueName: \"kubernetes.io/projected/187bd590-1842-4700-81bf-0fb8ddc5c883-kube-api-access-4n7w6\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-kubelet\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-multus-certs\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144463 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.145312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144481 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-run-ovn-kubernetes\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144494 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cnibin\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-system-cni-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-iptables-alerter-script\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-kubelet\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-os-release\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144559 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144579 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-log-socket\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-run-multus-certs\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/443d763d-e6c5-40b5-b19a-1fa43077e5a1-cnibin\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-conf\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144622 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-host-var-lib-cni-bin\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144661 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-run\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-sysctl-conf\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144728 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-registration-dir\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-etc-kubernetes\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144801 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-host-cni-bin\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.146291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144807 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-conf-dir\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144870 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-dbus\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144909 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-log-socket\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144972 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-sys-fs\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.144998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56935d44-34a2-4aed-8347-715d6b172d19-hosts-file\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56935d44-34a2-4aed-8347-715d6b172d19-tmp-dir\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145067 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-var-lib-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-modprobe-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145118 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-iptables-alerter-script\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145254 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-modprobe-d\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145261 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2233ae1d-6633-4e90-862b-cba09e833213-var-lib-openvswitch\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145312 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/182f02c3-60ea-499c-889c-94f34fa2c5ae-konnectivity-ca\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145430 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56935d44-34a2-4aed-8347-715d6b172d19-tmp-dir\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145443 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-multus-daemon-config\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.145913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-tmp\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.146739 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.146760 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:49.147200 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.146774 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:49.147913 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.146845 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:22:49.64682663 +0000 UTC m=+2.980879874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:49.148100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.148077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/182f02c3-60ea-499c-889c-94f34fa2c5ae-agent-certs\") pod \"konnectivity-agent-5fp84\" (UID: \"182f02c3-60ea-499c-889c-94f34fa2c5ae\") " pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.149535 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.149239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2233ae1d-6633-4e90-862b-cba09e833213-ovn-node-metrics-cert\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.150181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.150117 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jcd6\" (UniqueName: \"kubernetes.io/projected/8ba4f746-0a84-4e98-bed3-b203699f51a4-kube-api-access-6jcd6\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.150773 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.150748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxlwz\" (UniqueName: \"kubernetes.io/projected/1da7d03e-9c08-4efb-8dad-1cf23dad6b1e-kube-api-access-mxlwz\") pod \"iptables-alerter-vzx8r\" (UID: \"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e\") " pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.151305 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.151282 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-etc-tuned\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.151733 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.151704 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nz65\" (UniqueName: \"kubernetes.io/projected/56935d44-34a2-4aed-8347-715d6b172d19-kube-api-access-7nz65\") pod \"node-resolver-wbwgw\" (UID: \"56935d44-34a2-4aed-8347-715d6b172d19\") " pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.153137 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.152943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7q5\" (UniqueName: \"kubernetes.io/projected/e6f533d5-fca0-4f9a-b1e5-c86426a721bd-kube-api-access-rq7q5\") pod \"tuned-wdppg\" (UID: \"e6f533d5-fca0-4f9a-b1e5-c86426a721bd\") " pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.153229 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.153207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh6rr\" (UniqueName: \"kubernetes.io/projected/443d763d-e6c5-40b5-b19a-1fa43077e5a1-kube-api-access-hh6rr\") pod \"multus-additional-cni-plugins-r5jv9\" (UID: \"443d763d-e6c5-40b5-b19a-1fa43077e5a1\") " pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.154196 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.154175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8vcv\" (UniqueName: \"kubernetes.io/projected/2067a171-ac61-4b61-b6dc-0ff5a07c47bc-kube-api-access-f8vcv\") pod \"aws-ebs-csi-driver-node-zx86z\" (UID: \"2067a171-ac61-4b61-b6dc-0ff5a07c47bc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.154268 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.154175 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl4zz\" (UniqueName: \"kubernetes.io/projected/ab031cdc-f7d9-42b7-b630-5ef02a2127e1-kube-api-access-vl4zz\") pod \"multus-7mq5z\" (UID: \"ab031cdc-f7d9-42b7-b630-5ef02a2127e1\") " pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.154859 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.154842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpgt\" (UniqueName: \"kubernetes.io/projected/2233ae1d-6633-4e90-862b-cba09e833213-kube-api-access-jwpgt\") pod \"ovnkube-node-m5c28\" (UID: \"2233ae1d-6633-4e90-862b-cba09e833213\") " pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.155870 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.155837 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n7w6\" (UniqueName: \"kubernetes.io/projected/187bd590-1842-4700-81bf-0fb8ddc5c883-kube-api-access-4n7w6\") pod \"node-ca-wnjm5\" (UID: \"187bd590-1842-4700-81bf-0fb8ddc5c883\") " pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.320887 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.320843 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" Jun 11 19:22:49.328805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.328780 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wdppg" Jun 11 19:22:49.337313 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.337272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wnjm5" Jun 11 19:22:49.344756 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.344732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" Jun 11 19:22:49.352784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.352759 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vzx8r" Jun 11 19:22:49.359124 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.359101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:22:49.366295 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.366275 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:22:49.372913 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.372881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wbwgw" Jun 11 19:22:49.378410 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.378386 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7mq5z" Jun 11 19:22:49.649440 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.649362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:49.649440 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.649411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:49.649443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649471 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649492 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649506 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649542 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649554 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649561 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:22:50.649543711 +0000 UTC m=+3.983596941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649582 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:50.649569285 +0000 UTC m=+3.983622526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:49.649638 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:49.649601 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:50.649588847 +0000 UTC m=+3.983642075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:49.942222 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:49.942190 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187bd590_1842_4700_81bf_0fb8ddc5c883.slice/crio-728f94fe57e5a5baf9f2ab303cc532229545c667e45b29bda648aff3a1e6cdf9 WatchSource:0}: Error finding container 728f94fe57e5a5baf9f2ab303cc532229545c667e45b29bda648aff3a1e6cdf9: Status 404 returned error can't find the container with id 728f94fe57e5a5baf9f2ab303cc532229545c667e45b29bda648aff3a1e6cdf9 Jun 11 19:22:49.943893 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:49.943863 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da7d03e_9c08_4efb_8dad_1cf23dad6b1e.slice/crio-85015b55907dfa85b1be887bfb238025224e70c177cccd28762c8cb98a30ce5a WatchSource:0}: Error finding container 85015b55907dfa85b1be887bfb238025224e70c177cccd28762c8cb98a30ce5a: Status 404 returned error can't find the container with id 85015b55907dfa85b1be887bfb238025224e70c177cccd28762c8cb98a30ce5a Jun 11 19:22:49.945782 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:49.945432 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab031cdc_f7d9_42b7_b630_5ef02a2127e1.slice/crio-832b717bae9478bf4b5f0b2432e151c1cc1e8d6b7e43199015a8d5dedd9be117 WatchSource:0}: Error finding container 832b717bae9478bf4b5f0b2432e151c1cc1e8d6b7e43199015a8d5dedd9be117: Status 404 returned error can't find the container with id 832b717bae9478bf4b5f0b2432e151c1cc1e8d6b7e43199015a8d5dedd9be117 Jun 11 19:22:49.957030 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:49.957010 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f533d5_fca0_4f9a_b1e5_c86426a721bd.slice/crio-17f6f22ef01d0b07d2e1176033bbbd9c52723ad45cf951d6ea697f38461d59ad WatchSource:0}: Error finding container 17f6f22ef01d0b07d2e1176033bbbd9c52723ad45cf951d6ea697f38461d59ad: Status 404 returned error can't find the container with id 17f6f22ef01d0b07d2e1176033bbbd9c52723ad45cf951d6ea697f38461d59ad Jun 11 19:22:49.957340 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:22:49.957321 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod182f02c3_60ea_499c_889c_94f34fa2c5ae.slice/crio-e11b21bccfe8697627c97bdb6b5e225bd1079a659319fae3826a870e7676257c WatchSource:0}: Error finding container e11b21bccfe8697627c97bdb6b5e225bd1079a659319fae3826a870e7676257c: Status 404 returned error can't find the container with id e11b21bccfe8697627c97bdb6b5e225bd1079a659319fae3826a870e7676257c Jun 11 19:22:50.066290 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.066251 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:17:49 +0000 UTC" deadline="2027-11-05 05:19:32.797184882 +0000 UTC" Jun 11 19:22:50.066290 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.066285 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12273h56m42.730902987s" Jun 11 19:22:50.114185 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.114152 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdppg" event={"ID":"e6f533d5-fca0-4f9a-b1e5-c86426a721bd","Type":"ContainerStarted","Data":"17f6f22ef01d0b07d2e1176033bbbd9c52723ad45cf951d6ea697f38461d59ad"} Jun 11 19:22:50.115310 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.115276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5fp84" event={"ID":"182f02c3-60ea-499c-889c-94f34fa2c5ae","Type":"ContainerStarted","Data":"e11b21bccfe8697627c97bdb6b5e225bd1079a659319fae3826a870e7676257c"} Jun 11 19:22:50.116798 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.116775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" event={"ID":"2067a171-ac61-4b61-b6dc-0ff5a07c47bc","Type":"ContainerStarted","Data":"e12b06eb47ea509d5f7a17cb9d2255cf033c391243b915da316c94747af08526"} Jun 11 19:22:50.118013 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.117988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"bd46fe1520ecfbbd13613817a28a047f2ec7b60de6fe12c533dbcff3fac1072e"} Jun 11 19:22:50.119169 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.119146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnjm5" event={"ID":"187bd590-1842-4700-81bf-0fb8ddc5c883","Type":"ContainerStarted","Data":"728f94fe57e5a5baf9f2ab303cc532229545c667e45b29bda648aff3a1e6cdf9"} Jun 11 19:22:50.121497 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.121471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" event={"ID":"46a3b7e0737b02e9df1ca865f64b4f49","Type":"ContainerStarted","Data":"094e06b59bda82c62234ba3474cd8f3abb815ec710429af6441d3da07dd61be2"} Jun 11 19:22:50.123222 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.123197 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerStarted","Data":"ad635dbcf61d8b49611682b46a0cb7fa30dec0b73fd41710dd0eb394b9b94b81"} Jun 11 19:22:50.124525 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.124498 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbwgw" event={"ID":"56935d44-34a2-4aed-8347-715d6b172d19","Type":"ContainerStarted","Data":"e4985013ee8c0f2140305364a787ddffd4580ef73a9ee00facc10b3c2f4c6835"} Jun 11 19:22:50.126537 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.126508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzx8r" event={"ID":"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e","Type":"ContainerStarted","Data":"85015b55907dfa85b1be887bfb238025224e70c177cccd28762c8cb98a30ce5a"} Jun 11 19:22:50.127721 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.127702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mq5z" event={"ID":"ab031cdc-f7d9-42b7-b630-5ef02a2127e1","Type":"ContainerStarted","Data":"832b717bae9478bf4b5f0b2432e151c1cc1e8d6b7e43199015a8d5dedd9be117"} Jun 11 19:22:50.136281 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.136229 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-23.ec2.internal" podStartSLOduration=2.136212266 podStartE2EDuration="2.136212266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:22:50.136096101 +0000 UTC m=+3.470149347" watchObservedRunningTime="2026-06-11 19:22:50.136212266 +0000 UTC m=+3.470265512" Jun 11 19:22:50.656447 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.656401 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:50.656669 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.656476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:50.656669 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:50.656505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:50.656669 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.656651 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:50.656839 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.656715 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.656696985 +0000 UTC m=+5.990750227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:50.657194 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657169 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:50.657194 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657201 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:50.657194 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657215 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:50.657488 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657262 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.657247158 +0000 UTC m=+5.991300399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:50.657488 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657322 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:50.657488 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:50.657374 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.657344702 +0000 UTC m=+5.991397942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:51.067104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.066948 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:17:49 +0000 UTC" deadline="2027-11-29 23:52:29.893096808 +0000 UTC" Jun 11 19:22:51.067104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.067041 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12868h29m38.82608973s" Jun 11 19:22:51.105681 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.105643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:51.105844 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:51.105778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:51.106200 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.106180 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:51.106299 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:51.106275 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:22:51.106394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.106368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:51.106454 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:51.106441 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:51.136652 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.136615 2577 generic.go:356] "Generic (PLEG): container finished" podID="b9d54605153734652e785861cb7b4835" containerID="7930c69343567e578b43aa97c36be248fd98553aa79d27614319098a1d15afcb" exitCode=0 Jun 11 19:22:51.137579 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:51.137552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"b9d54605153734652e785861cb7b4835","Type":"ContainerDied","Data":"7930c69343567e578b43aa97c36be248fd98553aa79d27614319098a1d15afcb"} Jun 11 19:22:52.152667 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:52.151989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" event={"ID":"b9d54605153734652e785861cb7b4835","Type":"ContainerStarted","Data":"5ca44634f3ff4faf22655631420a5e1cb05bbf83ce876fcdc198cb3de3f6e799"} Jun 11 19:22:52.674591 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:52.674555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:52.674761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:52.674615 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:52.674761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:52.674644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:52.674883 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.674791 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:52.674883 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.674854 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:56.674835899 +0000 UTC m=+10.008889123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:52.675015 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.674998 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:52.675069 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.675049 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:56.67503512 +0000 UTC m=+10.009088363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:52.675160 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.675147 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:52.675219 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.675167 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:52.675219 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.675180 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:52.675318 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:52.675224 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:22:56.675209743 +0000 UTC m=+10.009262984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:53.106492 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:53.106454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:53.106667 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:53.106580 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:22:53.106979 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:53.106959 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:53.107077 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:53.107059 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:53.107271 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:53.107220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:53.107437 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:53.107412 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:55.106872 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:55.106838 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:55.107277 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:55.106972 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:55.107660 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:55.107389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:55.107660 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:55.107493 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:55.107660 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:55.107545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:55.107660 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:55.107614 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:22:56.711229 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:56.711188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:56.711247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:56.711275 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711388 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711413 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711426 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711438 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711393 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711481 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:23:04.711463979 +0000 UTC m=+18.045517220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711498 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:04.711488419 +0000 UTC m=+18.045541644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:56.711685 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:56.711512 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:04.711504385 +0000 UTC m=+18.045557611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:57.105913 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:57.105889 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:57.106204 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:57.106183 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:57.106626 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:57.106602 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:57.106831 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:57.106814 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:57.106999 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:57.106842 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:57.107131 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:57.107117 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:59.107080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:59.107216 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:59.107460 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:22:59.107560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:59.107558 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:22:59.107666 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:22:59.107636 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:01.105483 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:01.105451 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:01.105917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:01.105510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:01.105917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:01.105531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:01.105917 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:01.105617 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:01.105917 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:01.105732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:01.105917 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:01.105819 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:03.104940 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:03.104904 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:03.105391 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:03.105029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:03.105478 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:03.105452 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:03.105625 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:03.105563 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:03.105625 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:03.105594 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:03.105735 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:03.105668 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:04.768773 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:04.768729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:04.768773 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:04.768780 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:04.768842 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768898 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768941 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768957 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768967 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:20.768947589 +0000 UTC m=+34.103000830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768969 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.768975 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.769002 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:23:20.768992808 +0000 UTC m=+34.103046044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:04.769366 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:04.769043 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:20.769021966 +0000 UTC m=+34.103075193 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:05.105605 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:05.105521 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:05.105605 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:05.105561 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:05.105808 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:05.105531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:05.105808 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:05.105661 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:05.105808 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:05.105752 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:05.105978 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:05.105840 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:07.105427 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:07.105390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:07.105936 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:07.105483 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:07.105936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:07.105515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:07.105936 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:07.105618 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:07.105936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:07.105665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:07.105936 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:07.105746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:09.105106 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.104950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:09.105517 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.104965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:09.105517 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:09.105187 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:09.105517 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.104965 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:09.105517 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:09.105283 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:09.105517 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:09.105381 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:09.190742 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.190705 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wnjm5" event={"ID":"187bd590-1842-4700-81bf-0fb8ddc5c883","Type":"ContainerStarted","Data":"c1c6032bc8479ab899679dba51c023e46b5e8becf1dcc0d49ad28a628e7ce19b"} Jun 11 19:23:09.192485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.192405 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerStarted","Data":"9cfd9340e84f8e8c8ee6967daa96fe71f9c9d42faf0661c16f0762848c76f465"} Jun 11 19:23:09.198053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.197804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wbwgw" event={"ID":"56935d44-34a2-4aed-8347-715d6b172d19","Type":"ContainerStarted","Data":"fa21183889f8151e1f807cb535f4a7f2d449374449f103cdf89e8da62d4a91c3"} Jun 11 19:23:09.199376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.199329 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7mq5z" event={"ID":"ab031cdc-f7d9-42b7-b630-5ef02a2127e1","Type":"ContainerStarted","Data":"d72623b0db35184dda764ba1d94cc818a2da56d6890a32ee7b98e96fd18d8e17"} Jun 11 19:23:09.200947 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.200922 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wdppg" event={"ID":"e6f533d5-fca0-4f9a-b1e5-c86426a721bd","Type":"ContainerStarted","Data":"f05bf437bd2584d7fd853a0490592deac22294256ebc20048cd0d628854995fa"} Jun 11 19:23:09.202626 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.202597 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5fp84" event={"ID":"182f02c3-60ea-499c-889c-94f34fa2c5ae","Type":"ContainerStarted","Data":"9d0e84900eabc0ed5e4e7d11971b26c02e8322a2c8f6979c35678862a6b64c1b"} Jun 11 19:23:09.204144 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.204123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" event={"ID":"2067a171-ac61-4b61-b6dc-0ff5a07c47bc","Type":"ContainerStarted","Data":"8453baca3b5c2d841c144304e7324bef79952ddfdc549580529fb4e93370df9c"} Jun 11 19:23:09.205969 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.205939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:23:09.206273 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.206257 2577 generic.go:356] "Generic (PLEG): container finished" podID="2233ae1d-6633-4e90-862b-cba09e833213" containerID="c2dfb23f0eff2c75dba729d1418d20c45f5e41415708057b8f986afe88a1b330" exitCode=1 Jun 11 19:23:09.206335 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.206283 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerDied","Data":"c2dfb23f0eff2c75dba729d1418d20c45f5e41415708057b8f986afe88a1b330"} Jun 11 19:23:09.206335 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.206332 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"9aa85774f6cfa16baac0bbf7dfc005bfde8dad1ede7ab3df1b527200ef708b2e"} Jun 11 19:23:09.210160 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.210124 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wnjm5" podStartSLOduration=3.396057777 podStartE2EDuration="22.210112689s" totalImagesPullingTime="18.814054912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.209824267 +0000 UTC m=+22.543877513" watchObservedRunningTime="2026-06-11 19:23:09.210112689 +0000 UTC m=+22.544165934" Jun 11 19:23:09.210252 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.210199 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-23.ec2.internal" podStartSLOduration=21.210192809 podStartE2EDuration="21.210192809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:22:52.166879155 +0000 UTC m=+5.500932407" watchObservedRunningTime="2026-06-11 19:23:09.210192809 +0000 UTC m=+22.544246054" Jun 11 19:23:09.225795 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.225736 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5fp84" podStartSLOduration=8.026187409 podStartE2EDuration="22.22571432s" totalImagesPullingTime="14.199526911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.224970642 +0000 UTC m=+22.559023908" watchObservedRunningTime="2026-06-11 19:23:09.22571432 +0000 UTC m=+22.559767571" Jun 11 19:23:09.245212 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.245157 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wbwgw" podStartSLOduration=8.040975354 podStartE2EDuration="22.245134021s" totalImagesPullingTime="14.204158667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.244240117 +0000 UTC m=+22.578293362" watchObservedRunningTime="2026-06-11 19:23:09.245134021 +0000 UTC m=+22.579187270" Jun 11 19:23:09.292427 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.292379 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7mq5z" podStartSLOduration=3.415082688 podStartE2EDuration="22.29233599s" totalImagesPullingTime="18.877253302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.292237174 +0000 UTC m=+22.626290419" watchObservedRunningTime="2026-06-11 19:23:09.29233599 +0000 UTC m=+22.626389235" Jun 11 19:23:09.308800 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:09.308750 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wdppg" podStartSLOduration=3.480045984 podStartE2EDuration="22.308731911s" totalImagesPullingTime="18.828685927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.308104934 +0000 UTC m=+22.642158191" watchObservedRunningTime="2026-06-11 19:23:09.308731911 +0000 UTC m=+22.642785159" Jun 11 19:23:10.017035 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.017011 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:23:10.097387 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.097264 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:23:10.017032899Z","UUID":"d97dbb95-ad7f-4417-9550-577a7a2d7a56","Handler":null,"Name":"","Endpoint":""} Jun 11 19:23:10.098699 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.098683 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:23:10.098766 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.098710 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:23:10.210492 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.210449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" event={"ID":"2067a171-ac61-4b61-b6dc-0ff5a07c47bc","Type":"ContainerStarted","Data":"28b48197377974b0dba91355e5e8320190bb8f00f1d94de12b878049b700f3a1"} Jun 11 19:23:10.213051 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.213032 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:23:10.213442 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.213421 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"e6d17126cf200984d66ddb2a112f8b5bc076d9a1a01a5d49a83973e5bc4acc4f"} Jun 11 19:23:10.213525 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.213479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"5add33a03c41dd83f085e459cc58dbe045ece9c0e8d4a0b8bdf6758a64fd8311"} Jun 11 19:23:10.213525 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.213516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"cebd0496315b6504fef1bcaa9026f238ba82b1a98ad11cbee483f633eea99a43"} Jun 11 19:23:10.213595 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.213545 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"613bc1548dd5cfc0394d77106dcd5ba46b211beaaf245b622417cbff1e9b5ffa"} Jun 11 19:23:10.214743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.214720 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="9cfd9340e84f8e8c8ee6967daa96fe71f9c9d42faf0661c16f0762848c76f465" exitCode=0 Jun 11 19:23:10.214816 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.214757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"9cfd9340e84f8e8c8ee6967daa96fe71f9c9d42faf0661c16f0762848c76f465"} Jun 11 19:23:10.216213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.216191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vzx8r" event={"ID":"1da7d03e-9c08-4efb-8dad-1cf23dad6b1e","Type":"ContainerStarted","Data":"33dcb0d2e6f0032937af0c5bd8e9925df5cc310bb348577c61c3a35c67f77a62"} Jun 11 19:23:10.249729 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:10.249684 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vzx8r" podStartSLOduration=9.037250831 podStartE2EDuration="23.249670783s" totalImagesPullingTime="14.212419952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:10.249377669 +0000 UTC m=+23.583430910" watchObservedRunningTime="2026-06-11 19:23:10.249670783 +0000 UTC m=+23.583724027" Jun 11 19:23:11.105708 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:11.105676 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:11.105891 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:11.105677 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:11.105891 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:11.105802 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:11.105891 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:11.105818 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:11.106053 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:11.105894 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:11.106053 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:11.105990 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:11.221433 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:11.221397 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" event={"ID":"2067a171-ac61-4b61-b6dc-0ff5a07c47bc","Type":"ContainerStarted","Data":"f06400d61bf7e3e3f40bcf4db71c242c7d6fbec5d7f13a2a3206c559984b3bfa"} Jun 11 19:23:11.237629 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:11.237590 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zx86z" podStartSLOduration=3.860931828 podStartE2EDuration="24.237574991s" totalImagesPullingTime="20.376643163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:11.237559545 +0000 UTC m=+24.571612790" watchObservedRunningTime="2026-06-11 19:23:11.237574991 +0000 UTC m=+24.571628236" Jun 11 19:23:12.229840 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:12.229812 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:23:12.230318 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:12.230231 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"665e84fe83e7c473ee497e6f75af4daff83fc3fb53f88290bc2bcadf4dc99b31"} Jun 11 19:23:12.267131 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:12.267100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:23:12.267841 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:12.267815 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:23:13.105751 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:13.105720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:13.105934 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:13.105769 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:13.105934 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:13.105720 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:13.105934 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:13.105863 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:13.106091 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:13.105957 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:13.106091 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:13.106070 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:13.232744 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:13.232712 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:23:13.233536 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:13.233513 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5fp84" Jun 11 19:23:14.237830 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.237805 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:23:14.238263 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.238240 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"40ac33035d31f1544dee97dc5657c8ad289bc33bf4f4e93edf2f812c924bf754"} Jun 11 19:23:14.238631 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.238610 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:14.238739 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.238671 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:14.238795 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.238779 2577 scope.go:117] "RemoveContainer" containerID="c2dfb23f0eff2c75dba729d1418d20c45f5e41415708057b8f986afe88a1b330" Jun 11 19:23:14.255028 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:14.254996 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:15.105400 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.105371 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:15.105400 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.105391 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:15.105591 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:15.105472 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:15.105591 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.105501 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:15.105591 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:15.105564 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:15.105741 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:15.105646 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:15.244612 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.244585 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:23:15.245043 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.245024 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" event={"ID":"2233ae1d-6633-4e90-862b-cba09e833213","Type":"ContainerStarted","Data":"99a0ef714806b792b7d3529933ad5285f6bfe2ab9068ba417797346eaca0b64f"} Jun 11 19:23:15.246223 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.246203 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:15.248380 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.248337 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="2ef48d6179d530ac3b05c761b365de75b51c1af4c4cd12cd76402f018632c53b" exitCode=0 Jun 11 19:23:15.248503 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.248389 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"2ef48d6179d530ac3b05c761b365de75b51c1af4c4cd12cd76402f018632c53b"} Jun 11 19:23:15.263897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.263874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:15.272661 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:15.271706 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" podStartSLOduration=9.362756987 podStartE2EDuration="28.271689198s" totalImagesPullingTime="18.908932211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:15.270745625 +0000 UTC m=+28.604798882" watchObservedRunningTime="2026-06-11 19:23:15.271689198 +0000 UTC m=+28.605742445" Jun 11 19:23:16.021115 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.021083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rr6dj"] Jun 11 19:23:16.021293 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.021223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:16.021341 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:16.021321 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:16.023860 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.023833 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gc9hg"] Jun 11 19:23:16.024001 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.023936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:16.024098 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:16.024028 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:16.024484 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.024464 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ngc75"] Jun 11 19:23:16.024575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:16.024560 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:16.024665 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:16.024647 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:17.106303 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:17.106274 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:17.106906 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:17.106369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:17.253657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:17.253628 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="cbb33947d35b584bbd3a8c0b8a86a895a0450640a49f4ced9d89c4d0901da81e" exitCode=0 Jun 11 19:23:17.253783 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:17.253715 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"cbb33947d35b584bbd3a8c0b8a86a895a0450640a49f4ced9d89c4d0901da81e"} Jun 11 19:23:18.105460 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:18.105430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:18.105619 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:18.105430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:18.105619 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:18.105565 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:18.105619 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:18.105602 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:19.105736 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:19.105527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:19.106299 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:19.105832 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:19.260593 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:19.260553 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="7a50df3be861cb1580f1dc7b627a0613dcaa5b65cc6eaac4bb993b5dd298916f" exitCode=0 Jun 11 19:23:19.260745 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:19.260626 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"7a50df3be861cb1580f1dc7b627a0613dcaa5b65cc6eaac4bb993b5dd298916f"} Jun 11 19:23:20.105311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:20.105282 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:20.105478 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.105426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:23:20.105525 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:20.105478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:20.105581 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.105564 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rr6dj" podUID="8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c" Jun 11 19:23:20.786372 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:20.786331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:20.786480 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786492 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:20.786504 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786515 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786530 2577 projected.go:196] Error preparing data for projected volume kube-api-access-n2mpv for pod openshift-network-diagnostics/network-check-target-gc9hg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786594 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv podName:8bbe1ee8-3b33-4927-91b1-e76836aff91d nodeName:}" failed. No retries permitted until 2026-06-11 19:23:52.786576996 +0000 UTC m=+66.120630241 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n2mpv" (UniqueName: "kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv") pod "network-check-target-gc9hg" (UID: "8bbe1ee8-3b33-4927-91b1-e76836aff91d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786680 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786713 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786732 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret podName:8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:52.78672124 +0000 UTC m=+66.120774467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret") pod "global-pull-secret-syncer-rr6dj" (UID: "8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:20.786810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:20.786766 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:52.78675063 +0000 UTC m=+66.120803909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:21.105705 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:21.105622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:21.105851 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:21.105736 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gc9hg" podUID="8bbe1ee8-3b33-4927-91b1-e76836aff91d" Jun 11 19:23:21.983251 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:21.983221 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-23.ec2.internal" event="NodeReady" Jun 11 19:23:21.983814 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:21.983369 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:23:22.028368 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.028328 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8vm8f"] Jun 11 19:23:22.051214 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.051186 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-njqmp"] Jun 11 19:23:22.051362 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.051294 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.053085 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.053063 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:23:22.053207 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.053131 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:23:22.053268 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.053258 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j7vjf\"" Jun 11 19:23:22.066012 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.065992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vm8f"] Jun 11 19:23:22.066101 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.066023 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njqmp"] Jun 11 19:23:22.066143 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.066100 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.068020 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.068002 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:23:22.068148 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.068133 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:23:22.068381 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.068343 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:23:22.068453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.068386 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pnv6v\"" Jun 11 19:23:22.104826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.104807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:22.104961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.104948 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:22.107110 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.107090 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:23:22.107208 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.107128 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:23:22.107208 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.107151 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xcc7p\"" Jun 11 19:23:22.197973 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.197941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmr88\" (UniqueName: \"kubernetes.io/projected/fd844499-29b8-4186-8b70-32dacb2985ac-kube-api-access-gmr88\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.198136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.198005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd844499-29b8-4186-8b70-32dacb2985ac-config-volume\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.198136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.198040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqzd6\" (UniqueName: \"kubernetes.io/projected/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-kube-api-access-bqzd6\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.198136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.198090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd844499-29b8-4186-8b70-32dacb2985ac-tmp-dir\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.198136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.198116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-cert\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.198310 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.198177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.298614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298589 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd844499-29b8-4186-8b70-32dacb2985ac-tmp-dir\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.298824 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-cert\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.298824 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298683 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.298824 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmr88\" (UniqueName: \"kubernetes.io/projected/fd844499-29b8-4186-8b70-32dacb2985ac-kube-api-access-gmr88\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.298824 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd844499-29b8-4186-8b70-32dacb2985ac-config-volume\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.298824 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.298791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqzd6\" (UniqueName: \"kubernetes.io/projected/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-kube-api-access-bqzd6\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.299051 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:22.298917 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:22.299051 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:22.298977 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:22.798957791 +0000 UTC m=+36.133011014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:22.299051 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.299006 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd844499-29b8-4186-8b70-32dacb2985ac-tmp-dir\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.299627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.299610 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd844499-29b8-4186-8b70-32dacb2985ac-config-volume\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.303622 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.303600 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-cert\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.307750 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.307714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmr88\" (UniqueName: \"kubernetes.io/projected/fd844499-29b8-4186-8b70-32dacb2985ac-kube-api-access-gmr88\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.307940 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.307913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqzd6\" (UniqueName: \"kubernetes.io/projected/662ec37c-a7eb-4d29-ad0a-6750e33c2cbb-kube-api-access-bqzd6\") pod \"ingress-canary-njqmp\" (UID: \"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb\") " pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.373911 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.373881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njqmp" Jun 11 19:23:22.595704 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.595627 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njqmp"] Jun 11 19:23:22.600208 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:23:22.600177 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod662ec37c_a7eb_4d29_ad0a_6750e33c2cbb.slice/crio-7c2101a8b322095bd0d7e0bbab8171075739ffec5f4acae13854c7438c54ba85 WatchSource:0}: Error finding container 7c2101a8b322095bd0d7e0bbab8171075739ffec5f4acae13854c7438c54ba85: Status 404 returned error can't find the container with id 7c2101a8b322095bd0d7e0bbab8171075739ffec5f4acae13854c7438c54ba85 Jun 11 19:23:22.802307 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:22.802274 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:22.802494 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:22.802399 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:22.802494 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:22.802453 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:23.802440035 +0000 UTC m=+37.136493258 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:23.105467 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.105434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:23.107611 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.107583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:23:23.107735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.107628 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njf62\"" Jun 11 19:23:23.108133 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.108116 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:23:23.271663 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.271620 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njqmp" event={"ID":"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb","Type":"ContainerStarted","Data":"7c2101a8b322095bd0d7e0bbab8171075739ffec5f4acae13854c7438c54ba85"} Jun 11 19:23:23.810192 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:23.810154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:23.810394 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:23.810335 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:23.810459 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:23.810422 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:25.810406063 +0000 UTC m=+39.144459287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:25.826538 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:25.826506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:25.827337 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:25.826685 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:25.827337 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:25.826774 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:29.826753207 +0000 UTC m=+43.160806449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:26.281940 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:26.281909 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="16dcc50dec155f0a5b9447278c20eb3ce5b10788dc26a9e55c72ad7935ce287f" exitCode=0 Jun 11 19:23:26.282097 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:26.281986 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"16dcc50dec155f0a5b9447278c20eb3ce5b10788dc26a9e55c72ad7935ce287f"} Jun 11 19:23:26.283380 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:26.283338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njqmp" event={"ID":"662ec37c-a7eb-4d29-ad0a-6750e33c2cbb","Type":"ContainerStarted","Data":"6a01f04cb18dea5e7fb252b78da05e0524374089ef1545574714aece3f88cc21"} Jun 11 19:23:26.317609 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:26.317563 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-njqmp" podStartSLOduration=1.497605847 podStartE2EDuration="4.317546709s" totalImagesPullingTime="2.819940862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:26.316631559 +0000 UTC m=+39.650684805" watchObservedRunningTime="2026-06-11 19:23:26.317546709 +0000 UTC m=+39.651599975" Jun 11 19:23:27.288592 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:27.288560 2577 generic.go:356] "Generic (PLEG): container finished" podID="443d763d-e6c5-40b5-b19a-1fa43077e5a1" containerID="385833f995b8b4a93fef2ad12466d29b53adfd064811aadca2d8e747616473ce" exitCode=0 Jun 11 19:23:27.289040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:27.288634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerDied","Data":"385833f995b8b4a93fef2ad12466d29b53adfd064811aadca2d8e747616473ce"} Jun 11 19:23:28.293830 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:28.293792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" event={"ID":"443d763d-e6c5-40b5-b19a-1fa43077e5a1","Type":"ContainerStarted","Data":"78bc11ef3ce84a48f8c6340be0bf89c7a2ad5932cb0944ae3bdb84ce15e32df0"} Jun 11 19:23:28.316112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:28.316064 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r5jv9" podStartSLOduration=10.158219587 podStartE2EDuration="41.316048857s" totalImagesPullingTime="31.15782927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:28.315585268 +0000 UTC m=+41.649638519" watchObservedRunningTime="2026-06-11 19:23:28.316048857 +0000 UTC m=+41.650102101" Jun 11 19:23:29.852329 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:29.852288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:29.852711 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:29.852417 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:29.852711 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:29.852468 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:37.852454108 +0000 UTC m=+51.186507335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:37.913066 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:37.913027 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:37.913567 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:37.913210 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:37.913567 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:37.913299 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:23:53.913276203 +0000 UTC m=+67.247329429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:47.284451 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:47.284424 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m5c28" Jun 11 19:23:52.819986 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.819940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:52.819986 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.819995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:23:52.820534 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.820039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:52.822575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.822554 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:23:52.822754 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.822739 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:23:52.822804 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.822779 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:23:52.830384 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:52.830365 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:23:52.833725 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:52.830733 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:24:56.830412715 +0000 UTC m=+130.164465947 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : secret "metrics-daemon-secret" not found Jun 11 19:23:52.833725 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.832560 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:23:52.834634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.834614 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c-original-pull-secret\") pod \"global-pull-secret-syncer-rr6dj\" (UID: \"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c\") " pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:52.843315 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:52.843297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2mpv\" (UniqueName: \"kubernetes.io/projected/8bbe1ee8-3b33-4927-91b1-e76836aff91d-kube-api-access-n2mpv\") pod \"network-check-target-gc9hg\" (UID: \"8bbe1ee8-3b33-4927-91b1-e76836aff91d\") " pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:53.013975 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.013942 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rr6dj" Jun 11 19:23:53.120218 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.120187 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njf62\"" Jun 11 19:23:53.129037 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.129009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:53.132945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.132912 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rr6dj"] Jun 11 19:23:53.248972 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.248902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gc9hg"] Jun 11 19:23:53.252330 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:23:53.252297 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbe1ee8_3b33_4927_91b1_e76836aff91d.slice/crio-25f89adaa42f93ebffa0d90774b7cc2961107c7721db2e8d60908bf6e88acf7c WatchSource:0}: Error finding container 25f89adaa42f93ebffa0d90774b7cc2961107c7721db2e8d60908bf6e88acf7c: Status 404 returned error can't find the container with id 25f89adaa42f93ebffa0d90774b7cc2961107c7721db2e8d60908bf6e88acf7c Jun 11 19:23:53.352279 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.352214 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gc9hg" event={"ID":"8bbe1ee8-3b33-4927-91b1-e76836aff91d","Type":"ContainerStarted","Data":"25f89adaa42f93ebffa0d90774b7cc2961107c7721db2e8d60908bf6e88acf7c"} Jun 11 19:23:53.353287 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.353267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rr6dj" event={"ID":"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c","Type":"ContainerStarted","Data":"c39338cec6852c328e18d410aa42d0e5db7dd892cf5d828fa3f3d44d275a5bd9"} Jun 11 19:23:53.930165 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:53.930129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:23:53.930734 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:53.930272 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:53.930734 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:23:53.930339 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:24:25.930319609 +0000 UTC m=+99.264372832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:23:58.366932 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:58.366892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gc9hg" event={"ID":"8bbe1ee8-3b33-4927-91b1-e76836aff91d","Type":"ContainerStarted","Data":"c11e27efccd6247e6c040c8a953ad964bb1da76e523d91ffe660269cbd59bc99"} Jun 11 19:23:58.367343 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:58.366984 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:23:58.368256 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:58.368232 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rr6dj" event={"ID":"8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c","Type":"ContainerStarted","Data":"9a0e749a483860ff6df0d42cdc2df9ff85f0100b548af8b21e8fed36246f4bf6"} Jun 11 19:23:58.382777 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:58.382740 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gc9hg" podStartSLOduration=67.113997436 podStartE2EDuration="1m11.382727571s" totalImagesPullingTime="4.268730135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:58.381372819 +0000 UTC m=+71.715426063" watchObservedRunningTime="2026-06-11 19:23:58.382727571 +0000 UTC m=+71.716780794" Jun 11 19:23:58.395834 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:23:58.395796 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rr6dj" podStartSLOduration=67.00737784 podStartE2EDuration="1m11.395785629s" totalImagesPullingTime="4.388407789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:58.395630548 +0000 UTC m=+71.729683793" watchObservedRunningTime="2026-06-11 19:23:58.395785629 +0000 UTC m=+71.729838873" Jun 11 19:24:25.947774 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:24:25.947661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:24:25.948174 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:24:25.947818 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:24:25.948174 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:24:25.947886 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:25:29.947869777 +0000 UTC m=+163.281923003 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:24:29.373788 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:24:29.373761 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gc9hg" Jun 11 19:24:56.854741 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:24:56.854702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:24:56.855197 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:24:56.854810 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:24:56.855197 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:24:56.854871 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs podName:8ba4f746-0a84-4e98-bed3-b203699f51a4 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:58.854857583 +0000 UTC m=+252.188910805 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs") pod "network-metrics-daemon-ngc75" (UID: "8ba4f746-0a84-4e98-bed3-b203699f51a4") : secret "metrics-daemon-secret" not found Jun 11 19:25:25.060279 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:25.060228 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vm8f" podUID="fd844499-29b8-4186-8b70-32dacb2985ac" Jun 11 19:25:25.118234 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:25.118206 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ngc75" podUID="8ba4f746-0a84-4e98-bed3-b203699f51a4" Jun 11 19:25:25.568866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:25.568839 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:25:29.967691 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:29.967641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:25:29.968107 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:29.967766 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:25:29.968107 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:29.967819 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls podName:fd844499-29b8-4186-8b70-32dacb2985ac nodeName:}" failed. No retries permitted until 2026-06-11 19:27:31.967805634 +0000 UTC m=+285.301858857 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls") pod "dns-default-8vm8f" (UID: "fd844499-29b8-4186-8b70-32dacb2985ac") : secret "dns-default-metrics-tls" not found Jun 11 19:25:40.105397 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:40.105293 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:25:52.423156 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.423125 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-98kqh"] Jun 11 19:25:52.424949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.424934 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx"] Jun 11 19:25:52.425067 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.425048 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.426585 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.426566 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" Jun 11 19:25:52.428079 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.428064 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 19:25:52.428130 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.428069 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6pb52\"" Jun 11 19:25:52.428130 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.428114 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 19:25:52.430181 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.430163 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.430287 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.430207 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ttjd7\"" Jun 11 19:25:52.430287 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.430259 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.437104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.437084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-98kqh"] Jun 11 19:25:52.439458 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.439437 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx"] Jun 11 19:25:52.443799 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.443778 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k"] Jun 11 19:25:52.445790 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.445773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.447872 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.447854 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 19:25:52.447872 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.447862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.448015 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.447858 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.448015 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.447893 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cwwrx\"" Jun 11 19:25:52.456220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.456199 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k"] Jun 11 19:25:52.518044 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd486\" (UniqueName: \"kubernetes.io/projected/a6da7dea-1b4e-4ede-bc18-9307b73bd294-kube-api-access-qd486\") pod \"volume-data-source-validator-bd4ccd799-2h6bx\" (UID: \"a6da7dea-1b4e-4ede-bc18-9307b73bd294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" Jun 11 19:25:52.518044 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxx4\" (UniqueName: \"kubernetes.io/projected/9d302d32-eb0c-40d8-9ba4-693d478c6af6-kube-api-access-hlxx4\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.518213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518058 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-nginx-conf\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.518213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.518213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.518316 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.518284 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:25:52.519895 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.519880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df"] Jun 11 19:25:52.520024 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.520007 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.521522 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.521502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.525197 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.525167 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:25:52.525800 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.525786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:25:52.527823 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.527802 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.527928 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.527861 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.527992 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.527940 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:25:52.528107 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.528056 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 19:25:52.528107 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.528094 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwnxb\"" Jun 11 19:25:52.528635 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.528620 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 19:25:52.533344 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.533326 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vs69d\"" Jun 11 19:25:52.534568 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.534548 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:25:52.536474 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.536455 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df"] Jun 11 19:25:52.541029 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.541011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:25:52.618490 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618490 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618490 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618665 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd486\" (UniqueName: \"kubernetes.io/projected/a6da7dea-1b4e-4ede-bc18-9307b73bd294-kube-api-access-qd486\") pod \"volume-data-source-validator-bd4ccd799-2h6bx\" (UID: \"a6da7dea-1b4e-4ede-bc18-9307b73bd294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxx4\" (UniqueName: \"kubernetes.io/projected/9d302d32-eb0c-40d8-9ba4-693d478c6af6-kube-api-access-hlxx4\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618716 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-nginx-conf\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.618768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqbl\" (UniqueName: \"kubernetes.io/projected/57a6dfd1-c61c-444e-b876-25be51e3e804-kube-api-access-rnqbl\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618866 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw552\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.618997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57a6dfd1-c61c-444e-b876-25be51e3e804-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.619019 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.619026 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.619085 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls podName:9d302d32-eb0c-40d8-9ba4-693d478c6af6 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.119065759 +0000 UTC m=+186.453118982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls") pod "cluster-samples-operator-9547488fd-59h4k" (UID: "9d302d32-eb0c-40d8-9ba4-693d478c6af6") : secret "samples-operator-tls" not found Jun 11 19:25:52.619118 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.619116 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.119104599 +0000 UTC m=+186.453157825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:25:52.619413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.619394 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-nginx-conf\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:52.632932 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.632900 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxx4\" (UniqueName: \"kubernetes.io/projected/9d302d32-eb0c-40d8-9ba4-693d478c6af6-kube-api-access-hlxx4\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:52.633028 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.632905 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd486\" (UniqueName: \"kubernetes.io/projected/a6da7dea-1b4e-4ede-bc18-9307b73bd294-kube-api-access-qd486\") pod \"volume-data-source-validator-bd4ccd799-2h6bx\" (UID: \"a6da7dea-1b4e-4ede-bc18-9307b73bd294\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" Jun 11 19:25:52.719463 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719463 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.719463 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqbl\" (UniqueName: \"kubernetes.io/projected/57a6dfd1-c61c-444e-b876-25be51e3e804-kube-api-access-rnqbl\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.719627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719505 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw552\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719627 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.719523 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:52.719627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719627 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.719604 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.219590249 +0000 UTC m=+186.553643475 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:52.719627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57a6dfd1-c61c-444e-b876-25be51e3e804-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.719658 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.719672 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b7f79666-l68w5: secret "image-registry-tls" not found Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:52.719717 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls podName:e5f3badc-ad23-4b86-9e77-2725c4aa336d nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.219701712 +0000 UTC m=+186.553754935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls") pod "image-registry-64b7f79666-l68w5" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d") : secret "image-registry-tls" not found Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719658 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719781 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.719866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.719806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.720232 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.720210 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.720272 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.720257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.720408 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.720390 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57a6dfd1-c61c-444e-b876-25be51e3e804-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.720644 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.720596 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.722239 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.722220 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.722314 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.722264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.729851 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.729825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqbl\" (UniqueName: \"kubernetes.io/projected/57a6dfd1-c61c-444e-b876-25be51e3e804-kube-api-access-rnqbl\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:52.729945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.729928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.730145 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.730127 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw552\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:52.743816 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.743800 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" Jun 11 19:25:52.868805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:52.868775 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx"] Jun 11 19:25:52.871944 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:25:52.871920 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6da7dea_1b4e_4ede_bc18_9307b73bd294.slice/crio-071ce9589b3344673c37f3503c5dd440a456cb58d9ea153a2971d0da7e8b3172 WatchSource:0}: Error finding container 071ce9589b3344673c37f3503c5dd440a456cb58d9ea153a2971d0da7e8b3172: Status 404 returned error can't find the container with id 071ce9589b3344673c37f3503c5dd440a456cb58d9ea153a2971d0da7e8b3172 Jun 11 19:25:53.122491 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:53.122462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:53.122683 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:53.122501 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:53.122683 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.122619 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:25:53.122683 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.122620 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:25:53.122813 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.122691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls podName:9d302d32-eb0c-40d8-9ba4-693d478c6af6 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.122670586 +0000 UTC m=+187.456723816 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls") pod "cluster-samples-operator-9547488fd-59h4k" (UID: "9d302d32-eb0c-40d8-9ba4-693d478c6af6") : secret "samples-operator-tls" not found Jun 11 19:25:53.122813 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.122710 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.122701397 +0000 UTC m=+187.456754629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:25:53.223418 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:53.223376 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:53.223586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:53.223482 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:53.223586 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.223539 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:53.223665 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.223598 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:25:53.223665 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.223608 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.223589229 +0000 UTC m=+187.557642453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:53.223665 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.223611 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b7f79666-l68w5: secret "image-registry-tls" not found Jun 11 19:25:53.223665 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:53.223642 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls podName:e5f3badc-ad23-4b86-9e77-2725c4aa336d nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.223633153 +0000 UTC m=+187.557686392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls") pod "image-registry-64b7f79666-l68w5" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d") : secret "image-registry-tls" not found Jun 11 19:25:53.633185 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:53.633145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" event={"ID":"a6da7dea-1b4e-4ede-bc18-9307b73bd294","Type":"ContainerStarted","Data":"071ce9589b3344673c37f3503c5dd440a456cb58d9ea153a2971d0da7e8b3172"} Jun 11 19:25:54.129748 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.129725 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:54.129849 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.129764 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:54.129895 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.129869 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:25:54.129943 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.129909 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.129895951 +0000 UTC m=+189.463949174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:25:54.130017 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.129996 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:25:54.130090 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.130078 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls podName:9d302d32-eb0c-40d8-9ba4-693d478c6af6 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.130059877 +0000 UTC m=+189.464113116 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls") pod "cluster-samples-operator-9547488fd-59h4k" (UID: "9d302d32-eb0c-40d8-9ba4-693d478c6af6") : secret "samples-operator-tls" not found Jun 11 19:25:54.230588 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.230556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:54.230745 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.230620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:54.230745 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.230703 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:25:54.230745 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.230701 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:54.230745 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.230713 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b7f79666-l68w5: secret "image-registry-tls" not found Jun 11 19:25:54.230929 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.230778 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls podName:e5f3badc-ad23-4b86-9e77-2725c4aa336d nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.230752654 +0000 UTC m=+189.564805880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls") pod "image-registry-64b7f79666-l68w5" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d") : secret "image-registry-tls" not found Jun 11 19:25:54.230929 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:54.230792 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.230786012 +0000 UTC m=+189.564839235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:54.637252 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.637219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" event={"ID":"a6da7dea-1b4e-4ede-bc18-9307b73bd294","Type":"ContainerStarted","Data":"67e18adb1bc0a0fab6ac61cc7445b3951f63b8071f3c98ff52b6d3c4b0c91566"} Jun 11 19:25:54.653040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:54.652997 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-2h6bx" podStartSLOduration=1.417699117 podStartE2EDuration="2.652982558s" totalImagesPullingTime="1.235283441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:25:54.652809609 +0000 UTC m=+187.986862872" watchObservedRunningTime="2026-06-11 19:25:54.652982558 +0000 UTC m=+187.987035796" Jun 11 19:25:56.145051 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:56.145015 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:25:56.145564 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:56.145069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:25:56.145564 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.145181 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:25:56.145564 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.145188 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:25:56.145564 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.145225 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.145211337 +0000 UTC m=+193.479264573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:25:56.145564 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.145395 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls podName:9d302d32-eb0c-40d8-9ba4-693d478c6af6 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.145373473 +0000 UTC m=+193.479426716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls") pod "cluster-samples-operator-9547488fd-59h4k" (UID: "9d302d32-eb0c-40d8-9ba4-693d478c6af6") : secret "samples-operator-tls" not found Jun 11 19:25:56.246400 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:56.246342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:25:56.246544 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:56.246466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:25:56.246544 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.246499 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:25:56.246544 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.246515 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b7f79666-l68w5: secret "image-registry-tls" not found Jun 11 19:25:56.246659 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.246570 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls podName:e5f3badc-ad23-4b86-9e77-2725c4aa336d nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.246555317 +0000 UTC m=+193.580608560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls") pod "image-registry-64b7f79666-l68w5" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d") : secret "image-registry-tls" not found Jun 11 19:25:56.246659 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.246591 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:56.246659 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:56.246640 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.246627852 +0000 UTC m=+193.580681077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:25:58.896574 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.896537 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gf4kc"] Jun 11 19:25:58.898725 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.898703 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:58.901671 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.901646 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:25:58.901780 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.901665 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:25:58.901780 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.901676 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-746qd\"" Jun 11 19:25:58.901780 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.901678 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:25:58.902127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.902111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:25:58.914330 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.914304 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gf4kc"] Jun 11 19:25:58.970190 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.970155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:58.970404 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.970208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khdnt\" (UniqueName: \"kubernetes.io/projected/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-api-access-khdnt\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:58.970404 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.970239 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2759a527-0e5d-4494-b760-a6b0facff5fe-data-volume\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:58.970404 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.970304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2759a527-0e5d-4494-b760-a6b0facff5fe-crio-socket\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:58.970404 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:58.970331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071537 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khdnt\" (UniqueName: \"kubernetes.io/projected/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-api-access-khdnt\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071537 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2759a527-0e5d-4494-b760-a6b0facff5fe-data-volume\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071700 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071675 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2759a527-0e5d-4494-b760-a6b0facff5fe-crio-socket\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071739 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071800 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071780 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2759a527-0e5d-4494-b760-a6b0facff5fe-crio-socket\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071869 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.071869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2759a527-0e5d-4494-b760-a6b0facff5fe-data-volume\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.071949 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.071882 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:25:59.072009 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.071954 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:25:59.571933748 +0000 UTC m=+192.905986994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : configmap "kube-rbac-proxy" not found Jun 11 19:25:59.072009 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.071983 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.072076 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.072022 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:25:59.572010908 +0000 UTC m=+192.906064131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.080421 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.080392 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khdnt\" (UniqueName: \"kubernetes.io/projected/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-api-access-khdnt\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.575796 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.575757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.575962 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:25:59.575847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:25:59.575962 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.575913 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.576035 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.575958 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:25:59.576035 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.575984 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.575968678 +0000 UTC m=+193.910021920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.576035 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:25:59.576008 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.575994494 +0000 UTC m=+193.910047719 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : configmap "kube-rbac-proxy" not found Jun 11 19:26:00.180854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.180821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:26:00.181336 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.180940 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:26:00.181336 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.181007 2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 19:26:00.181336 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.181067 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:26:00.181336 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.181090 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls podName:9d302d32-eb0c-40d8-9ba4-693d478c6af6 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.181066586 +0000 UTC m=+201.515119824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls") pod "cluster-samples-operator-9547488fd-59h4k" (UID: "9d302d32-eb0c-40d8-9ba4-693d478c6af6") : secret "samples-operator-tls" not found Jun 11 19:26:00.181336 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.181116 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.181102118 +0000 UTC m=+201.515155357 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:26:00.281300 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.281257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:00.281505 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.281366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:26:00.281505 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.281445 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:26:00.281505 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.281449 2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 19:26:00.281505 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.281474 2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-64b7f79666-l68w5: secret "image-registry-tls" not found Jun 11 19:26:00.281505 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.281500 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.281486722 +0000 UTC m=+201.615539967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:26:00.281689 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.281531 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls podName:e5f3badc-ad23-4b86-9e77-2725c4aa336d nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.281518978 +0000 UTC m=+201.615572205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls") pod "image-registry-64b7f79666-l68w5" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d") : secret "image-registry-tls" not found Jun 11 19:26:00.583586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.583542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:00.583767 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:00.583629 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:00.583767 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.583707 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:00.583767 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.583712 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:00.583885 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.583772 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:02.583757392 +0000 UTC m=+195.917810617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : configmap "kube-rbac-proxy" not found Jun 11 19:26:00.583885 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:00.583784 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:02.583778387 +0000 UTC m=+195.917831610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:01.044924 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.044895 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-76k82"] Jun 11 19:26:01.046894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.046879 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.049220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.049191 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 19:26:01.049339 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.049192 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 19:26:01.049339 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.049192 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 19:26:01.049881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.049868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hpjxl\"" Jun 11 19:26:01.049946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.049901 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 19:26:01.055503 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.055485 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-76k82"] Jun 11 19:26:01.081549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.081527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbwgw_56935d44-34a2-4aed-8347-715d6b172d19/dns-node-resolver/0.log" Jun 11 19:26:01.086844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.086825 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-cabundle\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.086958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.086921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-key\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.086958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.086945 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl5mt\" (UniqueName: \"kubernetes.io/projected/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-kube-api-access-sl5mt\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.187467 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.187446 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-cabundle\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.187782 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.187521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-key\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.187782 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.187545 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl5mt\" (UniqueName: \"kubernetes.io/projected/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-kube-api-access-sl5mt\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.188059 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.188030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-cabundle\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.189984 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.189965 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-signing-key\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.197947 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.197924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl5mt\" (UniqueName: \"kubernetes.io/projected/6d4748ce-5ebc-4f67-90c4-dad29d58c3ad-kube-api-access-sl5mt\") pod \"service-ca-7b994bc59-76k82\" (UID: \"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad\") " pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.356327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.356233 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-76k82" Jun 11 19:26:01.476039 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.476006 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-76k82"] Jun 11 19:26:01.479276 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:01.479248 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4748ce_5ebc_4f67_90c4_dad29d58c3ad.slice/crio-0b8d8f6df18cf8665ae617bd0ca79d28827632adb1b19b2141dc5ee960a44dde WatchSource:0}: Error finding container 0b8d8f6df18cf8665ae617bd0ca79d28827632adb1b19b2141dc5ee960a44dde: Status 404 returned error can't find the container with id 0b8d8f6df18cf8665ae617bd0ca79d28827632adb1b19b2141dc5ee960a44dde Jun 11 19:26:01.654041 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:01.653963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-76k82" event={"ID":"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad","Type":"ContainerStarted","Data":"0b8d8f6df18cf8665ae617bd0ca79d28827632adb1b19b2141dc5ee960a44dde"} Jun 11 19:26:02.083178 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:02.083150 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnjm5_187bd590-1842-4700-81bf-0fb8ddc5c883/node-ca/0.log" Jun 11 19:26:02.597936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:02.597898 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:02.598413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:02.597995 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:02.598413 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:02.598078 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:02.598413 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:02.598108 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:02.598413 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:02.598163 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:06.598140851 +0000 UTC m=+199.932194088 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:02.598413 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:02.598183 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:06.598173027 +0000 UTC m=+199.932226254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : configmap "kube-rbac-proxy" not found Jun 11 19:26:02.883108 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:02.883024 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njqmp_662ec37c-a7eb-4d29-ad0a-6750e33c2cbb/serve-healthcheck-canary/0.log" Jun 11 19:26:04.668534 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:04.668487 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-76k82" event={"ID":"6d4748ce-5ebc-4f67-90c4-dad29d58c3ad","Type":"ContainerStarted","Data":"aa331f6c4ec9e8e3024f37a825964d46e6c61019a32532f641f03899db2359a4"} Jun 11 19:26:04.696917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:04.696860 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-76k82" podStartSLOduration=1.572343839 podStartE2EDuration="3.696845564s" totalImagesPullingTime="2.124501725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:04.695937047 +0000 UTC m=+198.029990315" watchObservedRunningTime="2026-06-11 19:26:04.696845564 +0000 UTC m=+198.030898808" Jun 11 19:26:06.629130 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:06.629091 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:06.629593 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:06.629215 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:06.629593 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:06.629220 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:06.629593 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:06.629284 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.629262016 +0000 UTC m=+207.963315242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : configmap "kube-rbac-proxy" not found Jun 11 19:26:06.629593 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:06.629340 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:06.629593 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:06.629416 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.629400201 +0000 UTC m=+207.963453438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:08.242572 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.242539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:26:08.243046 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.242625 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:26:08.243046 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:08.242723 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 19:26:08.243046 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:08.242796 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert podName:80ca7aeb-074a-4765-9bc6-5d815ed4f0c5 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.242778929 +0000 UTC m=+217.576832155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-98kqh" (UID: "80ca7aeb-074a-4765-9bc6-5d815ed4f0c5") : secret "networking-console-plugin-cert" not found Jun 11 19:26:08.245093 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.245074 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9d302d32-eb0c-40d8-9ba4-693d478c6af6-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-59h4k\" (UID: \"9d302d32-eb0c-40d8-9ba4-693d478c6af6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:26:08.343411 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.343368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:26:08.343575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.343452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:08.343575 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:08.343500 2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 19:26:08.343575 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:08.343567 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls podName:57a6dfd1-c61c-444e-b876-25be51e3e804 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.343552228 +0000 UTC m=+217.677605453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kz4df" (UID: "57a6dfd1-c61c-444e-b876-25be51e3e804") : secret "cluster-monitoring-operator-tls" not found Jun 11 19:26:08.345850 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.345828 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"image-registry-64b7f79666-l68w5\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:08.353899 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.353881 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" Jun 11 19:26:08.431762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.431430 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:08.491647 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.490624 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k"] Jun 11 19:26:08.562752 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.562726 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:26:08.567878 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:08.567856 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f3badc_ad23_4b86_9e77_2725c4aa336d.slice/crio-ac4760ee1f46528459bb6c406bc19c8d94e87e125c361323d8aa0ba7c759a080 WatchSource:0}: Error finding container ac4760ee1f46528459bb6c406bc19c8d94e87e125c361323d8aa0ba7c759a080: Status 404 returned error can't find the container with id ac4760ee1f46528459bb6c406bc19c8d94e87e125c361323d8aa0ba7c759a080 Jun 11 19:26:08.680849 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.680814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" event={"ID":"9d302d32-eb0c-40d8-9ba4-693d478c6af6","Type":"ContainerStarted","Data":"24e343a8be9482275d001dcac103bf3a99b51abe03e23785cf17fd38d78f4bd2"} Jun 11 19:26:08.682173 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.682147 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" event={"ID":"e5f3badc-ad23-4b86-9e77-2725c4aa336d","Type":"ContainerStarted","Data":"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9"} Jun 11 19:26:08.682296 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.682191 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" event={"ID":"e5f3badc-ad23-4b86-9e77-2725c4aa336d","Type":"ContainerStarted","Data":"ac4760ee1f46528459bb6c406bc19c8d94e87e125c361323d8aa0ba7c759a080"} Jun 11 19:26:08.682296 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.682236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:08.701532 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:08.701488 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" podStartSLOduration=16.701472976 podStartE2EDuration="16.701472976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:08.700549449 +0000 UTC m=+202.034602695" watchObservedRunningTime="2026-06-11 19:26:08.701472976 +0000 UTC m=+202.035526221" Jun 11 19:26:10.691733 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:10.691628 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" event={"ID":"9d302d32-eb0c-40d8-9ba4-693d478c6af6","Type":"ContainerStarted","Data":"1b321fafb5008055d3bf29314975a461440973dd5679dbb0df0e186c68e92ca3"} Jun 11 19:26:10.691733 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:10.691690 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" event={"ID":"9d302d32-eb0c-40d8-9ba4-693d478c6af6","Type":"ContainerStarted","Data":"a0b8537cb6e91d8e5e8eec5b5add951164d556f613a0e879b481ed9ab592dcae"} Jun 11 19:26:10.711072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:10.711020 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-59h4k" podStartSLOduration=16.856317875 podStartE2EDuration="18.711005246s" totalImagesPullingTime="1.854687371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:10.709670742 +0000 UTC m=+204.043723987" watchObservedRunningTime="2026-06-11 19:26:10.711005246 +0000 UTC m=+204.045058492" Jun 11 19:26:14.702210 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:14.702160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:14.702810 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:14.702261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:14.702810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:14.702288 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:14.702810 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:14.702376 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls podName:2759a527-0e5d-4494-b760-a6b0facff5fe nodeName:}" failed. No retries permitted until 2026-06-11 19:26:30.70233392 +0000 UTC m=+224.036387163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gf4kc" (UID: "2759a527-0e5d-4494-b760-a6b0facff5fe") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:14.702939 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:14.702888 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2759a527-0e5d-4494-b760-a6b0facff5fe-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:24.277761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.277722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:26:24.280167 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.280143 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ca7aeb-074a-4765-9bc6-5d815ed4f0c5-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-98kqh\" (UID: \"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:26:24.378751 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.378721 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:26:24.381335 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.381310 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57a6dfd1-c61c-444e-b876-25be51e3e804-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kz4df\" (UID: \"57a6dfd1-c61c-444e-b876-25be51e3e804\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:26:24.538216 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.538129 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" Jun 11 19:26:24.634677 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.634639 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" Jun 11 19:26:24.664526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.664491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-98kqh"] Jun 11 19:26:24.667830 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:24.667802 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ca7aeb_074a_4765_9bc6_5d815ed4f0c5.slice/crio-4db19b6247d5b8b3b9d110f0911f8724eeb27359c1bf912f9ca0e15bc43294bc WatchSource:0}: Error finding container 4db19b6247d5b8b3b9d110f0911f8724eeb27359c1bf912f9ca0e15bc43294bc: Status 404 returned error can't find the container with id 4db19b6247d5b8b3b9d110f0911f8724eeb27359c1bf912f9ca0e15bc43294bc Jun 11 19:26:24.735393 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.735362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" event={"ID":"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5","Type":"ContainerStarted","Data":"4db19b6247d5b8b3b9d110f0911f8724eeb27359c1bf912f9ca0e15bc43294bc"} Jun 11 19:26:24.763589 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:24.763555 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df"] Jun 11 19:26:24.766509 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:24.766482 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a6dfd1_c61c_444e_b876_25be51e3e804.slice/crio-47a163bcab7e0b6791182ae656ac85cc95095eedce1c408216403b7c1e3eb91e WatchSource:0}: Error finding container 47a163bcab7e0b6791182ae656ac85cc95095eedce1c408216403b7c1e3eb91e: Status 404 returned error can't find the container with id 47a163bcab7e0b6791182ae656ac85cc95095eedce1c408216403b7c1e3eb91e Jun 11 19:26:25.071317 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.071283 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:26:25.075117 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.075092 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-ksrsg"] Jun 11 19:26:25.076021 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.075992 2577 patch_prober.go:28] interesting pod/image-registry-64b7f79666-l68w5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:25.076146 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.076050 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:25.079420 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.079401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:25.081694 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.081671 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-v8snk\"" Jun 11 19:26:25.081801 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.081789 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 19:26:25.081868 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.081841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 19:26:25.093143 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.093122 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-ksrsg"] Jun 11 19:26:25.185726 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.185695 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fl76\" (UniqueName: \"kubernetes.io/projected/7cae750e-2ba3-418e-92b0-6dda68e176ab-kube-api-access-8fl76\") pod \"downloads-694c955b9-ksrsg\" (UID: \"7cae750e-2ba3-418e-92b0-6dda68e176ab\") " pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:25.286553 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.286515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fl76\" (UniqueName: \"kubernetes.io/projected/7cae750e-2ba3-418e-92b0-6dda68e176ab-kube-api-access-8fl76\") pod \"downloads-694c955b9-ksrsg\" (UID: \"7cae750e-2ba3-418e-92b0-6dda68e176ab\") " pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:25.294130 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.294109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fl76\" (UniqueName: \"kubernetes.io/projected/7cae750e-2ba3-418e-92b0-6dda68e176ab-kube-api-access-8fl76\") pod \"downloads-694c955b9-ksrsg\" (UID: \"7cae750e-2ba3-418e-92b0-6dda68e176ab\") " pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:25.389250 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.389168 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:25.534051 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.534014 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-ksrsg"] Jun 11 19:26:25.541438 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:25.541394 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cae750e_2ba3_418e_92b0_6dda68e176ab.slice/crio-e5480c07a750d119c07e003984b260f901de5ec66183b6e72a2f51672945f4a1 WatchSource:0}: Error finding container e5480c07a750d119c07e003984b260f901de5ec66183b6e72a2f51672945f4a1: Status 404 returned error can't find the container with id e5480c07a750d119c07e003984b260f901de5ec66183b6e72a2f51672945f4a1 Jun 11 19:26:25.740975 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.740852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-ksrsg" event={"ID":"7cae750e-2ba3-418e-92b0-6dda68e176ab","Type":"ContainerStarted","Data":"e5480c07a750d119c07e003984b260f901de5ec66183b6e72a2f51672945f4a1"} Jun 11 19:26:25.742427 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:25.742394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" event={"ID":"57a6dfd1-c61c-444e-b876-25be51e3e804","Type":"ContainerStarted","Data":"47a163bcab7e0b6791182ae656ac85cc95095eedce1c408216403b7c1e3eb91e"} Jun 11 19:26:27.224420 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.224290 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5"] Jun 11 19:26:27.227980 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.227960 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:27.229810 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.229785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 19:26:27.230114 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.230097 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jqx8f\"" Jun 11 19:26:27.237060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.237031 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5"] Jun 11 19:26:27.405366 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.405318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4de89c15-e677-4ace-837b-64575e555490-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-g7jr5\" (UID: \"4de89c15-e677-4ace-837b-64575e555490\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:27.505904 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.505811 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4de89c15-e677-4ace-837b-64575e555490-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-g7jr5\" (UID: \"4de89c15-e677-4ace-837b-64575e555490\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:27.509110 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.509085 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4de89c15-e677-4ace-837b-64575e555490-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-g7jr5\" (UID: \"4de89c15-e677-4ace-837b-64575e555490\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:27.540566 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.540533 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:27.693111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.693063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5"] Jun 11 19:26:27.696654 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:27.696621 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de89c15_e677_4ace_837b_64575e555490.slice/crio-eda0c5eefc3c7add486b1fbf864cc1ff89adff92f48b3eeb5e56cfbe24ee515f WatchSource:0}: Error finding container eda0c5eefc3c7add486b1fbf864cc1ff89adff92f48b3eeb5e56cfbe24ee515f: Status 404 returned error can't find the container with id eda0c5eefc3c7add486b1fbf864cc1ff89adff92f48b3eeb5e56cfbe24ee515f Jun 11 19:26:27.751206 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.751168 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" event={"ID":"4de89c15-e677-4ace-837b-64575e555490","Type":"ContainerStarted","Data":"eda0c5eefc3c7add486b1fbf864cc1ff89adff92f48b3eeb5e56cfbe24ee515f"} Jun 11 19:26:27.752803 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.752772 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" event={"ID":"80ca7aeb-074a-4765-9bc6-5d815ed4f0c5","Type":"ContainerStarted","Data":"d7abfe227c00457fe40565799c2f4b8e727c6fa8c144beaf4288d522cc37f5b8"} Jun 11 19:26:27.754392 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.754345 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" event={"ID":"57a6dfd1-c61c-444e-b876-25be51e3e804","Type":"ContainerStarted","Data":"8f283ea2a3ecb4e6c3d7f05408a9be6e5462b711aded84de69e8995718fed010"} Jun 11 19:26:27.770469 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.770425 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-98kqh" podStartSLOduration=33.762209451 podStartE2EDuration="35.77040807s" totalImagesPullingTime="2.008198619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.769262662 +0000 UTC m=+221.103315906" watchObservedRunningTime="2026-06-11 19:26:27.77040807 +0000 UTC m=+221.104461316" Jun 11 19:26:27.788008 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:27.787947 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kz4df" podStartSLOduration=33.87335329 podStartE2EDuration="35.787923434s" totalImagesPullingTime="1.914570144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:27.78695414 +0000 UTC m=+221.121007388" watchObservedRunningTime="2026-06-11 19:26:27.787923434 +0000 UTC m=+221.121976680" Jun 11 19:26:29.764711 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:29.764672 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" event={"ID":"4de89c15-e677-4ace-837b-64575e555490","Type":"ContainerStarted","Data":"ce5d11f41f264f61aac92f59123f1121952d3c1da9d36432d2e878d6aa5da66e"} Jun 11 19:26:29.765142 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:29.765030 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:29.770302 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:29.770277 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" Jun 11 19:26:29.781034 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:29.780982 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-g7jr5" podStartSLOduration=1.6048465570000001 podStartE2EDuration="2.78096924s" totalImagesPullingTime="1.176122683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:29.779943074 +0000 UTC m=+223.113996348" watchObservedRunningTime="2026-06-11 19:26:29.78096924 +0000 UTC m=+223.115022486" Jun 11 19:26:30.734519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:30.734485 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:30.737343 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:30.737311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2759a527-0e5d-4494-b760-a6b0facff5fe-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gf4kc\" (UID: \"2759a527-0e5d-4494-b760-a6b0facff5fe\") " pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:31.010077 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.010049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gf4kc" Jun 11 19:26:31.154593 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.150997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gf4kc"] Jun 11 19:26:31.158447 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:31.158415 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2759a527_0e5d_4494_b760_a6b0facff5fe.slice/crio-65cb6d1d4a703984513381a34e1578e80907ef2c8e8dfc550c7555b0197cd8f4 WatchSource:0}: Error finding container 65cb6d1d4a703984513381a34e1578e80907ef2c8e8dfc550c7555b0197cd8f4: Status 404 returned error can't find the container with id 65cb6d1d4a703984513381a34e1578e80907ef2c8e8dfc550c7555b0197cd8f4 Jun 11 19:26:31.447344 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.447270 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:26:31.451838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.451812 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.455100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455077 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 19:26:31.455253 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455168 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 19:26:31.455253 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455182 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 19:26:31.455634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455500 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 19:26:31.455634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455571 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 19:26:31.455634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.455594 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xmmrt\"" Jun 11 19:26:31.463689 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.463662 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:26:31.540629 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540597 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.540805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540634 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.540805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.540896 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.540896 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bdpf\" (UniqueName: \"kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.540982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.540903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641490 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641503 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641540 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bdpf\" (UniqueName: \"kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.641657 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.641643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.642950 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.642922 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.643900 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.643874 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.644009 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.643899 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.648987 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.646699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.648987 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.647067 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.653774 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.653741 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bdpf\" (UniqueName: \"kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf\") pod \"console-699fb899bf-rzvt9\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.763752 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.763721 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:31.775212 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.775145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf4kc" event={"ID":"2759a527-0e5d-4494-b760-a6b0facff5fe","Type":"ContainerStarted","Data":"65cb6d1d4a703984513381a34e1578e80907ef2c8e8dfc550c7555b0197cd8f4"} Jun 11 19:26:31.942649 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:31.942571 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:26:31.949763 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:31.949727 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e31c39_d9f2_4cae_aae1_21fda55fa989.slice/crio-6443b58a66d36051432dfd2304db8e376c5734efabdd3f5a984a0b51ee07ce89 WatchSource:0}: Error finding container 6443b58a66d36051432dfd2304db8e376c5734efabdd3f5a984a0b51ee07ce89: Status 404 returned error can't find the container with id 6443b58a66d36051432dfd2304db8e376c5734efabdd3f5a984a0b51ee07ce89 Jun 11 19:26:32.780968 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:32.780929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699fb899bf-rzvt9" event={"ID":"66e31c39-d9f2-4cae-aae1-21fda55fa989","Type":"ContainerStarted","Data":"6443b58a66d36051432dfd2304db8e376c5734efabdd3f5a984a0b51ee07ce89"} Jun 11 19:26:34.661267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.661231 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd"] Jun 11 19:26:34.665176 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.664739 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.667441 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.667214 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 19:26:34.670246 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.669539 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 19:26:34.670246 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.669784 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-w7k9h\"" Jun 11 19:26:34.670246 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.670064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:26:34.679764 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.679699 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd"] Jun 11 19:26:34.692986 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.692768 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qwns"] Jun 11 19:26:34.696571 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.696541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.700372 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.700257 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 19:26:34.700895 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.700712 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 19:26:34.701380 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.701244 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 19:26:34.701380 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.701293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xspfr\"" Jun 11 19:26:34.716955 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.716883 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qwns"] Jun 11 19:26:34.745363 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.743975 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gzc2g"] Jun 11 19:26:34.753726 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.753671 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.755894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.755748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:26:34.755894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.755765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:26:34.756081 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.755933 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:26:34.756081 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.756019 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b527p\"" Jun 11 19:26:34.770173 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.770150 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.770286 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.770193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c25ff998-49b8-4db0-b87c-dfd4e83778af-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.770286 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.770233 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57ngr\" (UniqueName: \"kubernetes.io/projected/c25ff998-49b8-4db0-b87c-dfd4e83778af-kube-api-access-57ngr\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.770425 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.770282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.871111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.870909 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-wtmp\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.870953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m25dm\" (UniqueName: \"kubernetes.io/projected/c9d31315-da39-4f90-8072-c480b7dea728-kube-api-access-m25dm\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.871111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.870997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-root\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871127 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c25ff998-49b8-4db0-b87c-dfd4e83778af-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rnt5\" (UniqueName: \"kubernetes.io/projected/2c206307-3ed6-4a88-91c2-913107d66caa-kube-api-access-2rnt5\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871242 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-sys\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871265 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-metrics-client-ca\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871288 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57ngr\" (UniqueName: \"kubernetes.io/projected/c25ff998-49b8-4db0-b87c-dfd4e83778af-kube-api-access-57ngr\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871399 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.871510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871505 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9d31315-da39-4f90-8072-c480b7dea728-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.872102 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.871531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-textfile\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.872818 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.872702 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c25ff998-49b8-4db0-b87c-dfd4e83778af-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.875581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.875537 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.875682 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.875628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c25ff998-49b8-4db0-b87c-dfd4e83778af-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.884013 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.883969 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57ngr\" (UniqueName: \"kubernetes.io/projected/c25ff998-49b8-4db0-b87c-dfd4e83778af-kube-api-access-57ngr\") pod \"openshift-state-metrics-6b8d965dd5-pd6hd\" (UID: \"c25ff998-49b8-4db0-b87c-dfd4e83778af\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.972441 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-wtmp\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972441 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972404 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m25dm\" (UniqueName: \"kubernetes.io/projected/c9d31315-da39-4f90-8072-c480b7dea728-kube-api-access-m25dm\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972448 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-root\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972576 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rnt5\" (UniqueName: \"kubernetes.io/projected/2c206307-3ed6-4a88-91c2-913107d66caa-kube-api-access-2rnt5\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-sys\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972650 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-metrics-client-ca\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972731 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972759 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972806 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9d31315-da39-4f90-8072-c480b7dea728-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.972982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.972832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-textfile\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973244 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.973172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-textfile\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973244 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.973228 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-sys\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973369 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.973331 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-wtmp\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973597 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.973582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c206307-3ed6-4a88-91c2-913107d66caa-root\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973687 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.973657 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-metrics-client-ca\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.973769 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:34.973753 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 19:26:34.973839 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:34.973810 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls podName:2c206307-3ed6-4a88-91c2-913107d66caa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:35.473792943 +0000 UTC m=+228.807846180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls") pod "node-exporter-gzc2g" (UID: "2c206307-3ed6-4a88-91c2-913107d66caa") : secret "node-exporter-tls" not found Jun 11 19:26:34.974476 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.974257 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9d31315-da39-4f90-8072-c480b7dea728-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.974577 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.974546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-accelerators-collector-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.974936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.974914 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.975026 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.974984 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9d31315-da39-4f90-8072-c480b7dea728-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.977155 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.977112 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:34.977738 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.977699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.978481 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.978434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9d31315-da39-4f90-8072-c480b7dea728-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.979199 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.979176 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" Jun 11 19:26:34.983846 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.983823 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m25dm\" (UniqueName: \"kubernetes.io/projected/c9d31315-da39-4f90-8072-c480b7dea728-kube-api-access-m25dm\") pod \"kube-state-metrics-678bc549d7-9qwns\" (UID: \"c9d31315-da39-4f90-8072-c480b7dea728\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:34.985860 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:34.985816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rnt5\" (UniqueName: \"kubernetes.io/projected/2c206307-3ed6-4a88-91c2-913107d66caa-kube-api-access-2rnt5\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:35.009827 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.009804 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" Jun 11 19:26:35.079191 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.078780 2577 patch_prober.go:28] interesting pod/image-registry-64b7f79666-l68w5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:35.079191 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.078839 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:35.477109 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.477066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:35.478004 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:35.477983 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 19:26:35.478125 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:35.478063 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls podName:2c206307-3ed6-4a88-91c2-913107d66caa nodeName:}" failed. No retries permitted until 2026-06-11 19:26:36.47803944 +0000 UTC m=+229.812092667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls") pod "node-exporter-gzc2g" (UID: "2c206307-3ed6-4a88-91c2-913107d66caa") : secret "node-exporter-tls" not found Jun 11 19:26:35.765126 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.765092 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:26:35.774845 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.774814 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.777371 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777324 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sk2cm\"" Jun 11 19:26:35.777488 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777408 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:26:35.777592 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777567 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:26:35.777655 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:26:35.777800 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777785 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:26:35.777847 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777802 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:26:35.777954 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777328 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:26:35.777954 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.777950 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:26:35.778148 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.778131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:26:35.778306 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.778293 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:26:35.783250 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.783151 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:26:35.882621 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882588 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882807 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882633 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882807 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882807 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882782 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvnk\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.882946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882898 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883062 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883062 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.882972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883062 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.883008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883062 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.883039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883233 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.883105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.883233 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.883149 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.984826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984784 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.984826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984951 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.984979 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985022 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985053 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985547 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985074 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985547 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.985547 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.985146 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvnk\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.986209 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:35.985853 2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 11 19:26:35.986209 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:35.985945 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls podName:b92686e4-d44e-436e-a963-b4f2709d0ce1 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:36.485917481 +0000 UTC m=+229.819970704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1") : secret "alertmanager-main-tls" not found Jun 11 19:26:35.986790 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.986462 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.986790 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.986578 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.986937 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.986777 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.990589 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.990565 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.991139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.991116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.991452 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.991405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.991562 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.991453 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.992058 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.991742 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.992058 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.992030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.992586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.992564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.992946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.992924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:35.998214 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:35.998190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvnk\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:36.488962 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.488921 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:36.489145 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.489005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:36.491914 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.491859 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c206307-3ed6-4a88-91c2-913107d66caa-node-exporter-tls\") pod \"node-exporter-gzc2g\" (UID: \"2c206307-3ed6-4a88-91c2-913107d66caa\") " pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:36.492043 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.491946 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:36.566151 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.566118 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gzc2g" Jun 11 19:26:36.688178 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:36.688146 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:26:37.674112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.674075 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-84c958778-gdd77"] Jun 11 19:26:37.679741 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.679713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681879 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681911 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4dz5z\"" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681928 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 19:26:37.682111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.681868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 19:26:37.682525 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.682216 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-f4l6sb1u6kbud\"" Jun 11 19:26:37.688500 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.687949 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84c958778-gdd77"] Jun 11 19:26:37.698696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698819 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698707 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698819 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698750 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca28822-e26f-4acc-aafd-b8626b1e3c63-metrics-client-ca\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698819 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9znw\" (UniqueName: \"kubernetes.io/projected/1ca28822-e26f-4acc-aafd-b8626b1e3c63-kube-api-access-z9znw\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698947 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.698996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.698972 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-grpc-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800317 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca28822-e26f-4acc-aafd-b8626b1e3c63-metrics-client-ca\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9znw\" (UniqueName: \"kubernetes.io/projected/1ca28822-e26f-4acc-aafd-b8626b1e3c63-kube-api-access-z9znw\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800727 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800542 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-grpc-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800727 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800581 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.800727 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.800607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.801201 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.801146 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ca28822-e26f-4acc-aafd-b8626b1e3c63-metrics-client-ca\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.804215 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.804192 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.804419 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.804344 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.804573 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.804554 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.805198 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.805172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.805567 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.805544 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.806517 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.806496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ca28822-e26f-4acc-aafd-b8626b1e3c63-secret-grpc-tls\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.809734 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.809710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9znw\" (UniqueName: \"kubernetes.io/projected/1ca28822-e26f-4acc-aafd-b8626b1e3c63-kube-api-access-z9znw\") pod \"thanos-querier-84c958778-gdd77\" (UID: \"1ca28822-e26f-4acc-aafd-b8626b1e3c63\") " pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:37.991625 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:37.991547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:38.992772 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.992737 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85496bbb68-59r2r"] Jun 11 19:26:38.994994 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.994975 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997612 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997612 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997658 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997674 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997621 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4lqudii7otnge\"" Jun 11 19:26:38.997817 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:38.997615 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-b7ggv\"" Jun 11 19:26:39.005796 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.005772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85496bbb68-59r2r"] Jun 11 19:26:39.010314 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-client-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010450 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010342 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-client-certs\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010450 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010447 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-tls\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010563 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtndj\" (UniqueName: \"kubernetes.io/projected/f0523267-95c9-4f5d-b990-778585c90c01-kube-api-access-wtndj\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010563 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010487 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-metrics-server-audit-profiles\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010668 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010627 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0523267-95c9-4f5d-b990-778585c90c01-audit-log\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.010718 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.010664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.111947 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.111915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-client-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.111959 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-client-certs\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.111984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-tls\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.112014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtndj\" (UniqueName: \"kubernetes.io/projected/f0523267-95c9-4f5d-b990-778585c90c01-kube-api-access-wtndj\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.112044 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-metrics-server-audit-profiles\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112331 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.112131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0523267-95c9-4f5d-b990-778585c90c01-audit-log\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112331 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.112161 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.112627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.112597 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f0523267-95c9-4f5d-b990-778585c90c01-audit-log\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.113240 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.113215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.113523 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.113496 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f0523267-95c9-4f5d-b990-778585c90c01-metrics-server-audit-profiles\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.115277 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.115248 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-client-certs\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.115384 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.115328 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-secret-metrics-server-tls\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.115445 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.115405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f0523267-95c9-4f5d-b990-778585c90c01-client-ca-bundle\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.122328 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.122305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtndj\" (UniqueName: \"kubernetes.io/projected/f0523267-95c9-4f5d-b990-778585c90c01-kube-api-access-wtndj\") pod \"metrics-server-85496bbb68-59r2r\" (UID: \"f0523267-95c9-4f5d-b990-778585c90c01\") " pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.309262 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.309229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:39.820616 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.820573 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:26:39.822776 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.822756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.830433 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.830279 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 19:26:39.833619 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.833598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:26:39.919397 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919340 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919565 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919419 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919565 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919565 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk9qw\" (UniqueName: \"kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919565 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919754 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919582 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:39.919754 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:39.919677 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.020706 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020772 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020805 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk9qw\" (UniqueName: \"kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021179 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.020912 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021579 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.021561 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.021726 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.021709 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.022194 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.022144 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.022444 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.022425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.023663 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.023639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.024249 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.024231 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.029023 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.029004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk9qw\" (UniqueName: \"kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw\") pod \"console-7dc549f776-z5sj5\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.134000 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.133917 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:40.906642 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.906590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:26:40.910420 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.910388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.913058 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.913034 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:26:40.913717 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.913696 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:26:40.913927 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.913912 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:26:40.914056 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.914035 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:26:40.914164 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.914144 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:26:40.914299 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.914269 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:26:40.914519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.914500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-42bknvegvrreh\"" Jun 11 19:26:40.914645 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.914529 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:26:40.915308 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.915288 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:26:40.920788 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.920536 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x987f\"" Jun 11 19:26:40.921119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.920537 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:26:40.921583 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.921565 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:26:40.922228 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.922202 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:26:40.922739 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.922717 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:26:40.924629 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.924104 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:26:40.928276 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:26:40.928467 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928445 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:26:40.928586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928481 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928681 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928709 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.928822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929049 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929049 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929049 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.928927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929049 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929015 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929047 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929083 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85jc\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929113 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929175 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:40.929283 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:40.929268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.029864 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.029814 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.029864 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.029865 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.029890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.029919 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.029946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030039 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030190 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030271 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030291 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d85jc\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.030394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.031118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.030826 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.031392 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.031335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.031507 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.031423 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.031507 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.031454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.031507 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.031483 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.033975 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.033941 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.034768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.034745 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.035408 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.035233 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.035613 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.035530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.035790 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.035770 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.036462 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.036021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.036462 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.036160 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.036462 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.036275 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.036662 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.036582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.037000 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.036979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.037103 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.037081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.037337 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.037276 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.037477 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.037432 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.038054 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.038031 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.038614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.038594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.038773 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.038756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.041050 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.041028 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.041586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.041569 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85jc\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc\") pod \"prometheus-k8s-0\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:41.226215 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:41.226135 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:26:44.181340 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.176566 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd"] Jun 11 19:26:44.212615 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.210574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-84c958778-gdd77"] Jun 11 19:26:44.223620 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:44.223590 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca28822_e26f_4acc_aafd_b8626b1e3c63.slice/crio-071680dd4030c7b7123efc88103be52c8b7e770756505382761352b638f2e1df WatchSource:0}: Error finding container 071680dd4030c7b7123efc88103be52c8b7e770756505382761352b638f2e1df: Status 404 returned error can't find the container with id 071680dd4030c7b7123efc88103be52c8b7e770756505382761352b638f2e1df Jun 11 19:26:44.425856 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.425801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-9qwns"] Jun 11 19:26:44.429154 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:44.429113 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d31315_da39_4f90_8072_c480b7dea728.slice/crio-517b566ffa02a223adffcb4b6862bb7f537d000446c0391e4faecebf453bd234 WatchSource:0}: Error finding container 517b566ffa02a223adffcb4b6862bb7f537d000446c0391e4faecebf453bd234: Status 404 returned error can't find the container with id 517b566ffa02a223adffcb4b6862bb7f537d000446c0391e4faecebf453bd234 Jun 11 19:26:44.439082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.437606 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:26:44.440497 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:44.440471 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92686e4_d44e_436e_a963_b4f2709d0ce1.slice/crio-105b978664ba3ef924545190e411e12599ad71dfa1e433ef1026b23a70a112ca WatchSource:0}: Error finding container 105b978664ba3ef924545190e411e12599ad71dfa1e433ef1026b23a70a112ca: Status 404 returned error can't find the container with id 105b978664ba3ef924545190e411e12599ad71dfa1e433ef1026b23a70a112ca Jun 11 19:26:44.441137 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.441113 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:26:44.450642 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.450609 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85496bbb68-59r2r"] Jun 11 19:26:44.451499 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:44.451457 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5fafb4_38f4_4ff0_be7f_07917a5f4b43.slice/crio-3ba96ce9dbc53c5e91a68fe721adb30693c51528d5a4981b9e2b2057ac435f8e WatchSource:0}: Error finding container 3ba96ce9dbc53c5e91a68fe721adb30693c51528d5a4981b9e2b2057ac435f8e: Status 404 returned error can't find the container with id 3ba96ce9dbc53c5e91a68fe721adb30693c51528d5a4981b9e2b2057ac435f8e Jun 11 19:26:44.453449 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.453420 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:26:44.833770 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.833730 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" event={"ID":"c9d31315-da39-4f90-8072-c480b7dea728","Type":"ContainerStarted","Data":"517b566ffa02a223adffcb4b6862bb7f537d000446c0391e4faecebf453bd234"} Jun 11 19:26:44.836609 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.836576 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" event={"ID":"c25ff998-49b8-4db0-b87c-dfd4e83778af","Type":"ContainerStarted","Data":"577b691d0e19af7580e9fda7533728f7875f69da12fbe3d1166d32460c76d980"} Jun 11 19:26:44.836756 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.836634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" event={"ID":"c25ff998-49b8-4db0-b87c-dfd4e83778af","Type":"ContainerStarted","Data":"88a8060a2c7e93bcf632f9911c4b72e8832b0f5c1043917d357068f0032f0f63"} Jun 11 19:26:44.836756 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.836663 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" event={"ID":"c25ff998-49b8-4db0-b87c-dfd4e83778af","Type":"ContainerStarted","Data":"7420d1a2f454a83f3e8377e85c1a7803f51d7dd8175a595ab5cc5d715c787796"} Jun 11 19:26:44.838586 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.838527 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-ksrsg" event={"ID":"7cae750e-2ba3-418e-92b0-6dda68e176ab","Type":"ContainerStarted","Data":"40d63fdf383eb7e771151b5c3a124dea42297a54c4cbcdc59775211bb8fc4885"} Jun 11 19:26:44.839338 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.839313 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:44.842472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.842446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc549f776-z5sj5" event={"ID":"0e33a8ea-770d-4632-aacb-bac450c352dd","Type":"ContainerStarted","Data":"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c"} Jun 11 19:26:44.842578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.842490 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc549f776-z5sj5" event={"ID":"0e33a8ea-770d-4632-aacb-bac450c352dd","Type":"ContainerStarted","Data":"4551ed8b24981b618deafc9b385d6aa6639a982d770eab8a647e9f205be48ee6"} Jun 11 19:26:44.844423 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.844394 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699fb899bf-rzvt9" event={"ID":"66e31c39-d9f2-4cae-aae1-21fda55fa989","Type":"ContainerStarted","Data":"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a"} Jun 11 19:26:44.845740 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.845676 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"3ba96ce9dbc53c5e91a68fe721adb30693c51528d5a4981b9e2b2057ac435f8e"} Jun 11 19:26:44.847261 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.847234 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"071680dd4030c7b7123efc88103be52c8b7e770756505382761352b638f2e1df"} Jun 11 19:26:44.849118 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.849092 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf4kc" event={"ID":"2759a527-0e5d-4494-b760-a6b0facff5fe","Type":"ContainerStarted","Data":"a55f1c281c2ce07adbb09807b8cb607e6608dacb29ee837e5052aec5585e5ce8"} Jun 11 19:26:44.850920 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.850887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" event={"ID":"f0523267-95c9-4f5d-b990-778585c90c01","Type":"ContainerStarted","Data":"efd58a0cbde90da0364526e3eb147ce49351e6dfe7c1da43887712802adce89f"} Jun 11 19:26:44.852368 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.852328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"105b978664ba3ef924545190e411e12599ad71dfa1e433ef1026b23a70a112ca"} Jun 11 19:26:44.854152 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.854129 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-ksrsg" Jun 11 19:26:44.854458 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.854432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzc2g" event={"ID":"2c206307-3ed6-4a88-91c2-913107d66caa","Type":"ContainerStarted","Data":"97111cd32186d69aacddd98af96c253d09b49d655e7b7917b81a19189b56ade0"} Jun 11 19:26:44.855831 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.855700 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-ksrsg" podStartSLOduration=1.393869342 podStartE2EDuration="19.855682981s" totalImagesPullingTime="18.461813639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:44.855023865 +0000 UTC m=+238.189077122" watchObservedRunningTime="2026-06-11 19:26:44.855682981 +0000 UTC m=+238.189736227" Jun 11 19:26:44.893508 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.893455 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-699fb899bf-rzvt9" podStartSLOduration=1.939461377 podStartE2EDuration="13.893435593s" totalImagesPullingTime="11.953974216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:44.875583871 +0000 UTC m=+238.209637153" watchObservedRunningTime="2026-06-11 19:26:44.893435593 +0000 UTC m=+238.227488838" Jun 11 19:26:44.916510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:44.915947 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc549f776-z5sj5" podStartSLOduration=5.915923874 podStartE2EDuration="5.915923874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:44.915343532 +0000 UTC m=+238.249396780" watchObservedRunningTime="2026-06-11 19:26:44.915923874 +0000 UTC m=+238.249977119" Jun 11 19:26:45.077972 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:45.077586 2577 patch_prober.go:28] interesting pod/image-registry-64b7f79666-l68w5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:45.077972 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:45.077641 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:45.873146 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:45.873054 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf4kc" event={"ID":"2759a527-0e5d-4494-b760-a6b0facff5fe","Type":"ContainerStarted","Data":"8d3143097d6e2cf3531eaf76c786b0da0298e48a9496d86cd4160fa820b930c6"} Jun 11 19:26:45.880873 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:45.878580 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c206307-3ed6-4a88-91c2-913107d66caa" containerID="80d9e451906b88a6ae9edeec60b36cbefa11d9114b178da0a9ec61b00daea77e" exitCode=0 Jun 11 19:26:45.880873 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:45.879828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzc2g" event={"ID":"2c206307-3ed6-4a88-91c2-913107d66caa","Type":"ContainerDied","Data":"80d9e451906b88a6ae9edeec60b36cbefa11d9114b178da0a9ec61b00daea77e"} Jun 11 19:26:46.889513 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:46.889380 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzc2g" event={"ID":"2c206307-3ed6-4a88-91c2-913107d66caa","Type":"ContainerStarted","Data":"860bdd840cc2be7125a57de94c24df5afb8c70c62b98a7f8a43b4aa2558d3753"} Jun 11 19:26:46.889513 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:46.889470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gzc2g" event={"ID":"2c206307-3ed6-4a88-91c2-913107d66caa","Type":"ContainerStarted","Data":"75160454d1509b6d923bee1ce657ddf0d1fe4feb4e4f8a8ace940ca5194f3495"} Jun 11 19:26:50.093338 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:50.093263 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" containerID="cri-o://9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9" gracePeriod=30 Jun 11 19:26:50.134524 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:50.134330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:50.134524 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:50.134418 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:26:50.136047 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:50.136016 2577 patch_prober.go:28] interesting pod/console-7dc549f776-z5sj5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 11 19:26:50.136171 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:50.136067 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 11 19:26:51.609462 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.609078 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:51.639316 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.638787 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gzc2g" podStartSLOduration=16.18324647 podStartE2EDuration="17.638764472s" totalImagesPullingTime="1.305065874s" totalInitContainerRuntime="150.452128ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:46.924388416 +0000 UTC m=+240.258441660" watchObservedRunningTime="2026-06-11 19:26:51.638764472 +0000 UTC m=+244.972817711" Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670231 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670274 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670335 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670417 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670461 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670501 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw552\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670544 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.671394 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.670570 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token\") pod \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\" (UID: \"e5f3badc-ad23-4b86-9e77-2725c4aa336d\") " Jun 11 19:26:51.674616 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.674548 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:26:51.677369 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.677302 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:26:51.688571 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.688521 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:26:51.689941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.689914 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:26:51.695434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.695401 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:26:51.697274 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.697237 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:26:51.699177 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.699136 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:26:51.700126 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.700095 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552" (OuterVolumeSpecName: "kube-api-access-zw552") pod "e5f3badc-ad23-4b86-9e77-2725c4aa336d" (UID: "e5f3badc-ad23-4b86-9e77-2725c4aa336d"). InnerVolumeSpecName "kube-api-access-zw552". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:26:51.765021 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.764847 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:51.765408 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.765305 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:26:51.766432 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.766382 2577 patch_prober.go:28] interesting pod/console-699fb899bf-rzvt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 11 19:26:51.766655 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.766582 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773790 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-image-registry-private-configuration\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773815 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e5f3badc-ad23-4b86-9e77-2725c4aa336d-ca-trust-extracted\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773831 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw552\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-kube-api-access-zw552\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773844 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-trusted-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773857 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-bound-sa-token\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773868 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773881 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e5f3badc-ad23-4b86-9e77-2725c4aa336d-registry-certificates\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.775735 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.773893 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e5f3badc-ad23-4b86-9e77-2725c4aa336d-installation-pull-secrets\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:26:51.913019 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.912775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gf4kc" event={"ID":"2759a527-0e5d-4494-b760-a6b0facff5fe","Type":"ContainerStarted","Data":"27bc3f2b50cf43e0157969606146004a1b247125d8868bfb9ffacba25e5a1a2c"} Jun 11 19:26:51.916894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.916842 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" event={"ID":"f0523267-95c9-4f5d-b990-778585c90c01","Type":"ContainerStarted","Data":"0af4ce433a517e14b1760a866a2162eb42ff0bfc74d82a04f0dd698e4cce2ffd"} Jun 11 19:26:51.918411 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.918386 2577 generic.go:356] "Generic (PLEG): container finished" podID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerID="9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9" exitCode=0 Jun 11 19:26:51.918565 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.918547 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" Jun 11 19:26:51.918705 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.918686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" event={"ID":"e5f3badc-ad23-4b86-9e77-2725c4aa336d","Type":"ContainerDied","Data":"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9"} Jun 11 19:26:51.918828 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.918811 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64b7f79666-l68w5" event={"ID":"e5f3badc-ad23-4b86-9e77-2725c4aa336d","Type":"ContainerDied","Data":"ac4760ee1f46528459bb6c406bc19c8d94e87e125c361323d8aa0ba7c759a080"} Jun 11 19:26:51.918938 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.918925 2577 scope.go:117] "RemoveContainer" containerID="9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9" Jun 11 19:26:51.926469 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.925876 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9" exitCode=0 Jun 11 19:26:51.926469 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.925962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9"} Jun 11 19:26:51.931976 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.931377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" event={"ID":"c9d31315-da39-4f90-8072-c480b7dea728","Type":"ContainerStarted","Data":"03f865406ed62f1e59f4de0769d3e690c191781e36da296b3a4c80d93a8b35d2"} Jun 11 19:26:51.931976 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.931427 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" event={"ID":"c9d31315-da39-4f90-8072-c480b7dea728","Type":"ContainerStarted","Data":"9f8c722bb3982e334ad641ccaee53007b7f6d35b262d540ea5173a8fa5bea3d7"} Jun 11 19:26:51.936492 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.936098 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" event={"ID":"c25ff998-49b8-4db0-b87c-dfd4e83778af","Type":"ContainerStarted","Data":"cfb064db1e94ff75952717daf723db73716f8202efba1e48b5b9f03e593d8d44"} Jun 11 19:26:51.938383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.938335 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" exitCode=0 Jun 11 19:26:51.938454 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.938435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} Jun 11 19:26:51.940175 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.940133 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gf4kc" podStartSLOduration=33.960500288 podStartE2EDuration="53.940114904s" totalImagesPullingTime="19.979614616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:25:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:51.939655254 +0000 UTC m=+245.273708524" watchObservedRunningTime="2026-06-11 19:26:51.940114904 +0000 UTC m=+245.274168150" Jun 11 19:26:51.942031 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.941886 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"98882ea198c6e17d6292e989bd9df449f4ee4f65140470f7d742837c8a043ce6"} Jun 11 19:26:51.953877 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.953777 2577 scope.go:117] "RemoveContainer" containerID="9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9" Jun 11 19:26:51.956639 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:26:51.956613 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9\": container with ID starting with 9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9 not found: ID does not exist" containerID="9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9" Jun 11 19:26:51.956811 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:51.956774 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9"} err="failed to get container status \"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9\": rpc error: code = NotFound desc = could not find container \"9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9\": container with ID starting with 9d945f858edcbf2dbdb0cc6b89b8a80086d9ec8dd51460dff614850aaf86ddf9 not found: ID does not exist" Jun 11 19:26:52.013634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.013567 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" podStartSLOduration=7.072558321 podStartE2EDuration="14.013545792s" totalImagesPullingTime="6.940987471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:51.977816072 +0000 UTC m=+245.311869318" watchObservedRunningTime="2026-06-11 19:26:52.013545792 +0000 UTC m=+245.347599018" Jun 11 19:26:52.067548 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.067490 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-pd6hd" podStartSLOduration=10.919283049 podStartE2EDuration="18.067469329s" totalImagesPullingTime="7.14818628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:52.067116936 +0000 UTC m=+245.401170198" watchObservedRunningTime="2026-06-11 19:26:52.067469329 +0000 UTC m=+245.401522575" Jun 11 19:26:52.084758 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.084735 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:26:52.091030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.091000 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-64b7f79666-l68w5"] Jun 11 19:26:52.951658 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.951570 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"2795e33ac3b1eea92f5d8e632a866aa6b0d24dae17fcd451c97e2a38ce9ed859"} Jun 11 19:26:52.952245 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.952218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"33b6b19c9fd758e648e5d65a092610940df22d006a59b7f73637955b3b7aec90"} Jun 11 19:26:52.956085 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.956058 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" event={"ID":"c9d31315-da39-4f90-8072-c480b7dea728","Type":"ContainerStarted","Data":"a62255a016017d85a8af24cd83b04620383456096d652b06f54a18b8bd1264b4"} Jun 11 19:26:52.982663 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:52.979777 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-9qwns" podStartSLOduration=11.938076762 podStartE2EDuration="18.979751409s" totalImagesPullingTime="7.041674647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:52.976977634 +0000 UTC m=+246.311030882" watchObservedRunningTime="2026-06-11 19:26:52.979751409 +0000 UTC m=+246.313804659" Jun 11 19:26:53.113450 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:53.113086 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" path="/var/lib/kubelet/pods/e5f3badc-ad23-4b86-9e77-2725c4aa336d/volumes" Jun 11 19:26:54.970917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.970880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"a1cb061e0e8dc2ffb4ffcb41c691b1667df6a1e9a1836c909dd95c86ac6851a6"} Jun 11 19:26:54.971472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.970990 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"f375772ef37f460f328a37d837da5e97cbf1b9ab58a9a5a92a6bf598a0fb12a7"} Jun 11 19:26:54.971472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.971047 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:26:54.971472 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.971087 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" event={"ID":"1ca28822-e26f-4acc-aafd-b8626b1e3c63","Type":"ContainerStarted","Data":"6aef8b6a6deb79bf135f2168a096089a8624ddfead36399392de385babed333f"} Jun 11 19:26:54.973576 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.973551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db"} Jun 11 19:26:54.973692 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.973623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b"} Jun 11 19:26:54.973692 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.973658 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72"} Jun 11 19:26:54.996134 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:54.996087 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" podStartSLOduration=8.778255246 podStartE2EDuration="17.996071033s" totalImagesPullingTime="9.217815787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:54.99378067 +0000 UTC m=+248.327833915" watchObservedRunningTime="2026-06-11 19:26:54.996071033 +0000 UTC m=+248.330124278" Jun 11 19:26:55.982491 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:55.982449 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6"} Jun 11 19:26:55.983028 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:55.982535 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236"} Jun 11 19:26:56.991479 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:56.991322 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} Jun 11 19:26:56.997774 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:56.997743 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerStarted","Data":"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf"} Jun 11 19:26:57.034895 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:57.034840 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=12.389816086 podStartE2EDuration="22.034819379s" totalImagesPullingTime="9.60737488s" totalInitContainerRuntime="37.628413ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:57.033888532 +0000 UTC m=+250.367941811" watchObservedRunningTime="2026-06-11 19:26:57.034819379 +0000 UTC m=+250.368872632" Jun 11 19:26:58.005765 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.005673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} Jun 11 19:26:58.005765 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.005738 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} Jun 11 19:26:58.005765 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.005766 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} Jun 11 19:26:58.006320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.005789 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} Jun 11 19:26:58.006320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.005814 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerStarted","Data":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} Jun 11 19:26:58.039127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.039074 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.171237604 podStartE2EDuration="18.039059191s" totalImagesPullingTime="11.837884919s" totalInitContainerRuntime="29.936668ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:58.038014585 +0000 UTC m=+251.372067830" watchObservedRunningTime="2026-06-11 19:26:58.039059191 +0000 UTC m=+251.373112437" Jun 11 19:26:58.950189 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.950149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:26:58.952549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:58.952530 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ba4f746-0a84-4e98-bed3-b203699f51a4-metrics-certs\") pod \"network-metrics-daemon-ngc75\" (UID: \"8ba4f746-0a84-4e98-bed3-b203699f51a4\") " pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:26:59.008113 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:59.008076 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xcc7p\"" Jun 11 19:26:59.016910 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:59.016888 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ngc75" Jun 11 19:26:59.189829 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:59.189801 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ngc75"] Jun 11 19:26:59.192116 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:26:59.192081 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba4f746_0a84_4e98_bed3_b203699f51a4.slice/crio-0c375bb48f7e493019c21afb181ba9945ec08b4b703bd6464ea237aaee5d643f WatchSource:0}: Error finding container 0c375bb48f7e493019c21afb181ba9945ec08b4b703bd6464ea237aaee5d643f: Status 404 returned error can't find the container with id 0c375bb48f7e493019c21afb181ba9945ec08b4b703bd6464ea237aaee5d643f Jun 11 19:26:59.310189 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:59.310149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:26:59.310397 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:26:59.310231 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:27:00.017296 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:00.017263 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngc75" event={"ID":"8ba4f746-0a84-4e98-bed3-b203699f51a4","Type":"ContainerStarted","Data":"0c375bb48f7e493019c21afb181ba9945ec08b4b703bd6464ea237aaee5d643f"} Jun 11 19:27:00.134778 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:00.134738 2577 patch_prober.go:28] interesting pod/console-7dc549f776-z5sj5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 11 19:27:00.134996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:00.134786 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 11 19:27:00.988326 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:00.988263 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-84c958778-gdd77" Jun 11 19:27:01.026960 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.026929 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngc75" event={"ID":"8ba4f746-0a84-4e98-bed3-b203699f51a4","Type":"ContainerStarted","Data":"e525e5d75b0aedf9a49bddb2098b9e56c12cd2c2ebce881c654f49505b816ea2"} Jun 11 19:27:01.027311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.026980 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ngc75" event={"ID":"8ba4f746-0a84-4e98-bed3-b203699f51a4","Type":"ContainerStarted","Data":"db365a15286c9752c52556bc7f8bbf9eca6d002409c8799c56d1e99b369d9d85"} Jun 11 19:27:01.044829 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.044773 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ngc75" podStartSLOduration=252.513469163 podStartE2EDuration="4m14.044758466s" totalImagesPullingTime="1.531289303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:01.04330002 +0000 UTC m=+254.377353286" watchObservedRunningTime="2026-06-11 19:27:01.044758466 +0000 UTC m=+254.378811711" Jun 11 19:27:01.226676 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.226641 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:27:01.764170 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.764141 2577 patch_prober.go:28] interesting pod/console-699fb899bf-rzvt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 11 19:27:01.764376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:01.764186 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 11 19:27:06.254171 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:06.254102 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/init-config-reloader/0.log" Jun 11 19:27:06.454143 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:06.454112 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/alertmanager/0.log" Jun 11 19:27:06.654554 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:06.654519 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/config-reloader/0.log" Jun 11 19:27:06.854251 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:06.854223 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/kube-rbac-proxy-web/0.log" Jun 11 19:27:07.065499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:07.065471 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/kube-rbac-proxy/0.log" Jun 11 19:27:07.255110 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:07.255077 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/kube-rbac-proxy-metric/0.log" Jun 11 19:27:07.454002 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:07.453912 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b92686e4-d44e-436e-a963-b4f2709d0ce1/prom-label-proxy/0.log" Jun 11 19:27:07.656019 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:07.655987 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-kz4df_57a6dfd1-c61c-444e-b876-25be51e3e804/cluster-monitoring-operator/0.log" Jun 11 19:27:07.855518 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:07.855477 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-state-metrics/0.log" Jun 11 19:27:08.054860 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:08.054834 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-rbac-proxy-main/0.log" Jun 11 19:27:08.255866 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:08.255782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-rbac-proxy-self/0.log" Jun 11 19:27:08.454547 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:08.454516 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85496bbb68-59r2r_f0523267-95c9-4f5d-b990-778585c90c01/metrics-server/0.log" Jun 11 19:27:09.454114 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:09.454085 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/init-textfile/0.log" Jun 11 19:27:09.655553 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:09.655527 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/node-exporter/0.log" Jun 11 19:27:09.854603 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:09.854574 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/kube-rbac-proxy/0.log" Jun 11 19:27:10.135442 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:10.135330 2577 patch_prober.go:28] interesting pod/console-7dc549f776-z5sj5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 11 19:27:10.135442 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:10.135421 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 11 19:27:10.655574 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:10.655540 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/kube-rbac-proxy-main/0.log" Jun 11 19:27:10.854303 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:10.854272 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/kube-rbac-proxy-self/0.log" Jun 11 19:27:11.060234 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.060210 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/openshift-state-metrics/0.log" Jun 11 19:27:11.254020 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.253990 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/init-config-reloader/0.log" Jun 11 19:27:11.456535 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.456437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/prometheus/0.log" Jun 11 19:27:11.654854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.654830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/config-reloader/0.log" Jun 11 19:27:11.764675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.764639 2577 patch_prober.go:28] interesting pod/console-699fb899bf-rzvt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 11 19:27:11.765070 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.764698 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 11 19:27:11.855037 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:11.855011 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/thanos-sidecar/0.log" Jun 11 19:27:12.054956 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:12.054867 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/kube-rbac-proxy-web/0.log" Jun 11 19:27:12.255290 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:12.255259 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/kube-rbac-proxy/0.log" Jun 11 19:27:12.455492 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:12.455419 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/kube-rbac-proxy-thanos/0.log" Jun 11 19:27:13.054500 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:13.054469 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-g7jr5_4de89c15-e677-4ace-837b-64575e555490/prometheus-operator-admission-webhook/0.log" Jun 11 19:27:13.254318 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:13.254287 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/thanos-query/0.log" Jun 11 19:27:13.453906 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:13.453827 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-web/0.log" Jun 11 19:27:13.654296 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:13.654267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy/0.log" Jun 11 19:27:13.854386 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:13.854340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/prom-label-proxy/0.log" Jun 11 19:27:14.053484 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:14.053457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-rules/0.log" Jun 11 19:27:14.254533 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:14.254454 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-metrics/0.log" Jun 11 19:27:14.454595 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:14.454571 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-98kqh_80ca7aeb-074a-4765-9bc6-5d815ed4f0c5/networking-console-plugin/0.log" Jun 11 19:27:15.055754 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:15.055726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-699fb899bf-rzvt9_66e31c39-d9f2-4cae-aae1-21fda55fa989/console/0.log" Jun 11 19:27:15.255075 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:15.255046 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7dc549f776-z5sj5_0e33a8ea-770d-4632-aacb-bac450c352dd/console/0.log" Jun 11 19:27:15.457524 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:15.457436 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-ksrsg_7cae750e-2ba3-418e-92b0-6dda68e176ab/download-server/0.log" Jun 11 19:27:17.254298 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:17.254255 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbwgw_56935d44-34a2-4aed-8347-715d6b172d19/dns-node-resolver/0.log" Jun 11 19:27:18.255036 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:18.255010 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnjm5_187bd590-1842-4700-81bf-0fb8ddc5c883/node-ca/0.log" Jun 11 19:27:19.053754 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:19.053723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njqmp_662ec37c-a7eb-4d29-ad0a-6750e33c2cbb/serve-healthcheck-canary/0.log" Jun 11 19:27:19.314935 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:19.314851 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:27:19.318995 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:19.318969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85496bbb68-59r2r" Jun 11 19:27:20.135153 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:20.135119 2577 patch_prober.go:28] interesting pod/console-7dc549f776-z5sj5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 11 19:27:20.135340 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:20.135183 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 11 19:27:21.764243 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:21.764207 2577 patch_prober.go:28] interesting pod/console-699fb899bf-rzvt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 11 19:27:21.764671 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:21.764274 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 11 19:27:28.569304 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:28.569265 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8vm8f" podUID="fd844499-29b8-4186-8b70-32dacb2985ac" Jun 11 19:27:29.153100 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:29.153070 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:30.134856 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:30.134820 2577 patch_prober.go:28] interesting pod/console-7dc549f776-z5sj5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jun 11 19:27:30.135251 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:30.134897 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jun 11 19:27:31.765189 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:31.765149 2577 patch_prober.go:28] interesting pod/console-699fb899bf-rzvt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 11 19:27:31.765709 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:31.765211 2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 11 19:27:32.053331 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:32.053246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:32.055658 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:32.055639 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd844499-29b8-4186-8b70-32dacb2985ac-metrics-tls\") pod \"dns-default-8vm8f\" (UID: \"fd844499-29b8-4186-8b70-32dacb2985ac\") " pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:32.156589 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:32.156564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j7vjf\"" Jun 11 19:27:32.164851 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:32.164830 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:32.318973 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:32.318950 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8vm8f"] Jun 11 19:27:32.321194 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:27:32.321169 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd844499_29b8_4186_8b70_32dacb2985ac.slice/crio-d0e01d66e0150b5fd6f268c79f3f0f224f871caef052e505432ba6d9b4292c77 WatchSource:0}: Error finding container d0e01d66e0150b5fd6f268c79f3f0f224f871caef052e505432ba6d9b4292c77: Status 404 returned error can't find the container with id d0e01d66e0150b5fd6f268c79f3f0f224f871caef052e505432ba6d9b4292c77 Jun 11 19:27:33.169932 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:33.169900 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vm8f" event={"ID":"fd844499-29b8-4186-8b70-32dacb2985ac","Type":"ContainerStarted","Data":"d0e01d66e0150b5fd6f268c79f3f0f224f871caef052e505432ba6d9b4292c77"} Jun 11 19:27:35.179465 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:35.179388 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vm8f" event={"ID":"fd844499-29b8-4186-8b70-32dacb2985ac","Type":"ContainerStarted","Data":"718f5ad5983d8aadc5552634cc5e4e62d10312a2d3877192588ee9f26ac82b3a"} Jun 11 19:27:35.179465 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:35.179444 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8vm8f" event={"ID":"fd844499-29b8-4186-8b70-32dacb2985ac","Type":"ContainerStarted","Data":"b3aee28c568a5bec7c563d1c9fb7266573817d7ac158b919618e9e6d50c25537"} Jun 11 19:27:35.179842 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:35.179521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:35.198910 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:35.198861 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8vm8f" podStartSLOduration=250.92985152400001 podStartE2EDuration="4m13.198844285s" totalImagesPullingTime="2.268992761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:35.198261023 +0000 UTC m=+288.532314269" watchObservedRunningTime="2026-06-11 19:27:35.198844285 +0000 UTC m=+288.532897539" Jun 11 19:27:40.138718 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:40.138682 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:27:40.142396 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:40.142373 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:27:40.208127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:40.208100 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:27:41.227365 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:41.227333 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:27:41.246701 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:41.246678 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:27:42.223969 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:42.223944 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:27:45.186864 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:45.186830 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8vm8f" Jun 11 19:27:47.061221 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:47.061196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:27:47.062165 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:47.062146 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:27:47.067226 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:47.067209 2577 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:27:55.020295 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020246 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020714 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="alertmanager" containerID="cri-o://2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72" gracePeriod=120 Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020768 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="prom-label-proxy" containerID="cri-o://dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf" gracePeriod=120 Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020811 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-web" containerID="cri-o://8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db" gracePeriod=120 Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020821 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="config-reloader" containerID="cri-o://9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b" gracePeriod=120 Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020768 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-metric" containerID="cri-o://4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6" gracePeriod=120 Jun 11 19:27:55.022743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.020827 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy" containerID="cri-o://4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236" gracePeriod=120 Jun 11 19:27:55.266267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266233 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf" exitCode=0 Jun 11 19:27:55.266267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266260 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6" exitCode=0 Jun 11 19:27:55.266267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266267 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236" exitCode=0 Jun 11 19:27:55.266267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266273 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b" exitCode=0 Jun 11 19:27:55.266267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266278 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72" exitCode=0 Jun 11 19:27:55.266578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf"} Jun 11 19:27:55.266578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266383 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6"} Jun 11 19:27:55.266578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266409 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236"} Jun 11 19:27:55.266578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266434 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b"} Jun 11 19:27:55.266578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:55.266459 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72"} Jun 11 19:27:56.259001 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.258979 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.262743 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262724 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.262826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262759 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.262826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262784 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.262933 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262886 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.262933 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262927 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263037 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.262964 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263037 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263007 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263264 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263291 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263333 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263338 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263390 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263417 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263562 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263623 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:27:56.263863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263645 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spvnk\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk\") pod \"b92686e4-d44e-436e-a963-b4f2709d0ce1\" (UID: \"b92686e4-d44e-436e-a963-b4f2709d0ce1\") " Jun 11 19:27:56.264588 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263941 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-metrics-client-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.264588 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263964 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.264588 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.263980 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-alertmanager-main-db\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.266083 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.265968 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.266083 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.266055 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.266579 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.266335 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:27:56.266724 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.266655 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk" (OuterVolumeSpecName: "kube-api-access-spvnk") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "kube-api-access-spvnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:27:56.267060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.267026 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume" (OuterVolumeSpecName: "config-volume") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.267858 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.267823 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.268095 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.268069 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.268281 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.268231 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out" (OuterVolumeSpecName: "config-out") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:27:56.273485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.273323 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.274833 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.274728 2577 generic.go:356] "Generic (PLEG): container finished" podID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerID="8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db" exitCode=0 Jun 11 19:27:56.274833 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.274804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db"} Jun 11 19:27:56.275013 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.274835 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.275013 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.274874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b92686e4-d44e-436e-a963-b4f2709d0ce1","Type":"ContainerDied","Data":"105b978664ba3ef924545190e411e12599ad71dfa1e433ef1026b23a70a112ca"} Jun 11 19:27:56.275013 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.274911 2577 scope.go:117] "RemoveContainer" containerID="dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf" Jun 11 19:27:56.281139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.280967 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config" (OuterVolumeSpecName: "web-config") pod "b92686e4-d44e-436e-a963-b4f2709d0ce1" (UID: "b92686e4-d44e-436e-a963-b4f2709d0ce1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:27:56.289041 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.288992 2577 scope.go:117] "RemoveContainer" containerID="4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6" Jun 11 19:27:56.297615 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.297596 2577 scope.go:117] "RemoveContainer" containerID="4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236" Jun 11 19:27:56.305549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.305530 2577 scope.go:117] "RemoveContainer" containerID="8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db" Jun 11 19:27:56.313246 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.313222 2577 scope.go:117] "RemoveContainer" containerID="9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b" Jun 11 19:27:56.321117 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.321097 2577 scope.go:117] "RemoveContainer" containerID="2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72" Jun 11 19:27:56.329205 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.329183 2577 scope.go:117] "RemoveContainer" containerID="8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9" Jun 11 19:27:56.337390 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.337342 2577 scope.go:117] "RemoveContainer" containerID="dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf" Jun 11 19:27:56.337684 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.337667 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf\": container with ID starting with dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf not found: ID does not exist" containerID="dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf" Jun 11 19:27:56.337724 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.337694 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf"} err="failed to get container status \"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf\": rpc error: code = NotFound desc = could not find container \"dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf\": container with ID starting with dbfb1d361caba5f14c67522a88d299ddbfb8f083cd1316c741ec2416636107bf not found: ID does not exist" Jun 11 19:27:56.337724 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.337712 2577 scope.go:117] "RemoveContainer" containerID="4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6" Jun 11 19:27:56.337957 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.337942 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6\": container with ID starting with 4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6 not found: ID does not exist" containerID="4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6" Jun 11 19:27:56.338008 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.337961 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6"} err="failed to get container status \"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6\": rpc error: code = NotFound desc = could not find container \"4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6\": container with ID starting with 4dfdf71961b47d44bb0ce18240b254eb143fedbf87143a0cf66531326e3e18b6 not found: ID does not exist" Jun 11 19:27:56.338008 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.337974 2577 scope.go:117] "RemoveContainer" containerID="4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236" Jun 11 19:27:56.338197 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.338174 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236\": container with ID starting with 4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236 not found: ID does not exist" containerID="4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236" Jun 11 19:27:56.338259 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338206 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236"} err="failed to get container status \"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236\": rpc error: code = NotFound desc = could not find container \"4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236\": container with ID starting with 4525987be20dc5dc36e4cededbeed46c5b6aff2192ade2cad647c79fd38d2236 not found: ID does not exist" Jun 11 19:27:56.338259 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338227 2577 scope.go:117] "RemoveContainer" containerID="8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db" Jun 11 19:27:56.338474 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.338450 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db\": container with ID starting with 8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db not found: ID does not exist" containerID="8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db" Jun 11 19:27:56.338520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338480 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db"} err="failed to get container status \"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db\": rpc error: code = NotFound desc = could not find container \"8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db\": container with ID starting with 8afee4b8dc3808dfa2939c879acf446f496762ce2e7273bba45ab067b74d38db not found: ID does not exist" Jun 11 19:27:56.338520 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338494 2577 scope.go:117] "RemoveContainer" containerID="9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b" Jun 11 19:27:56.338761 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.338744 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b\": container with ID starting with 9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b not found: ID does not exist" containerID="9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b" Jun 11 19:27:56.338805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338764 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b"} err="failed to get container status \"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b\": rpc error: code = NotFound desc = could not find container \"9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b\": container with ID starting with 9efe35306493fda210aba29d8536f140485962d0e311a8a9ff27deb50ff11a1b not found: ID does not exist" Jun 11 19:27:56.338805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.338778 2577 scope.go:117] "RemoveContainer" containerID="2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72" Jun 11 19:27:56.339002 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.338986 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72\": container with ID starting with 2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72 not found: ID does not exist" containerID="2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72" Jun 11 19:27:56.339047 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.339006 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72"} err="failed to get container status \"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72\": rpc error: code = NotFound desc = could not find container \"2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72\": container with ID starting with 2d280038be81af37187fa9f0b0bbea12be11555f5292aa8ea025357ec9a31e72 not found: ID does not exist" Jun 11 19:27:56.339047 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.339021 2577 scope.go:117] "RemoveContainer" containerID="8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9" Jun 11 19:27:56.339210 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:27:56.339195 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9\": container with ID starting with 8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9 not found: ID does not exist" containerID="8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9" Jun 11 19:27:56.339246 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.339217 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9"} err="failed to get container status \"8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9\": rpc error: code = NotFound desc = could not find container \"8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9\": container with ID starting with 8c7eeb8c011bbb7dfdad154bdbccda2390b43d7a0e7b5a8e4e2a2e5630da4ca9 not found: ID does not exist" Jun 11 19:27:56.365308 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365282 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-main-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365308 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365306 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-web-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365320 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-tls-assets\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365332 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365344 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-out\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365382 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-cluster-tls-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365395 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-config-volume\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365408 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365422 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spvnk\" (UniqueName: \"kubernetes.io/projected/b92686e4-d44e-436e-a963-b4f2709d0ce1-kube-api-access-spvnk\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.365519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.365435 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b92686e4-d44e-436e-a963-b4f2709d0ce1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:27:56.600553 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.600508 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:56.605251 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.605229 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:56.635592 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635564 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:56.635899 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635886 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="config-reloader" Jun 11 19:27:56.635941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635901 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="config-reloader" Jun 11 19:27:56.635941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635911 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="alertmanager" Jun 11 19:27:56.635941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635916 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="alertmanager" Jun 11 19:27:56.635941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635936 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-web" Jun 11 19:27:56.635941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635942 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-web" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635948 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635955 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635965 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-metric" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635970 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-metric" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635979 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="init-config-reloader" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635985 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="init-config-reloader" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635994 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="prom-label-proxy" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.635998 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="prom-label-proxy" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636009 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636014 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636061 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="alertmanager" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636071 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="config-reloader" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636076 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5f3badc-ad23-4b86-9e77-2725c4aa336d" containerName="registry" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636082 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy" Jun 11 19:27:56.636082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636088 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-web" Jun 11 19:27:56.636500 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636093 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="kube-rbac-proxy-metric" Jun 11 19:27:56.636500 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.636099 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" containerName="prom-label-proxy" Jun 11 19:27:56.639934 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.639919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.642191 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642161 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 19:27:56.642191 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642170 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 19:27:56.642373 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642226 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sk2cm\"" Jun 11 19:27:56.642373 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642175 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 19:27:56.642373 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642287 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 19:27:56.642521 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.642421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 19:27:56.644542 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.644527 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 19:27:56.644832 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.644818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 19:27:56.645000 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.644984 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 19:27:56.648897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.648879 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 19:27:56.657502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.657481 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:56.668668 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668882 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668882 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668839 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.668941 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.669003 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668942 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.669003 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64h85\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-kube-api-access-64h85\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.669003 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.668993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-out\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.669092 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.669010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-web-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769739 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769739 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769735 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769757 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769868 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64h85\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-kube-api-access-64h85\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.769945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769929 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-out\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770125 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.769947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-web-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770125 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770030 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770125 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770125 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770089 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770125 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770117 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770403 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770135 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770403 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770403 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770287 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.770751 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.770724 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.771552 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.771504 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e7dd384-0eec-4d79-87a1-c1b232432d87-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773233 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773184 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773317 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773631 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773579 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773631 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-out\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773640 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-web-config\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.773955 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.773936 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-config-volume\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.774133 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.774119 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.774719 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.774703 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7e7dd384-0eec-4d79-87a1-c1b232432d87-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.778511 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.778494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64h85\" (UniqueName: \"kubernetes.io/projected/7e7dd384-0eec-4d79-87a1-c1b232432d87-kube-api-access-64h85\") pod \"alertmanager-main-0\" (UID: \"7e7dd384-0eec-4d79-87a1-c1b232432d87\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:56.949145 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:56.949071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 19:27:57.102744 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:57.102712 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 19:27:57.106435 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:27:57.106344 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7dd384_0eec_4d79_87a1_c1b232432d87.slice/crio-408b4995311a8ef99cab9fce673f58c891914c2c6c7158b896572697721f5816 WatchSource:0}: Error finding container 408b4995311a8ef99cab9fce673f58c891914c2c6c7158b896572697721f5816: Status 404 returned error can't find the container with id 408b4995311a8ef99cab9fce673f58c891914c2c6c7158b896572697721f5816 Jun 11 19:27:57.112552 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:57.112508 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b92686e4-d44e-436e-a963-b4f2709d0ce1" path="/var/lib/kubelet/pods/b92686e4-d44e-436e-a963-b4f2709d0ce1/volumes" Jun 11 19:27:57.280495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:57.280459 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e7dd384-0eec-4d79-87a1-c1b232432d87" containerID="76f314e43d27dd75d8d10be025cc374992512acd4948aba1b625c6f8bce0d39c" exitCode=0 Jun 11 19:27:57.280976 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:57.280549 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerDied","Data":"76f314e43d27dd75d8d10be025cc374992512acd4948aba1b625c6f8bce0d39c"} Jun 11 19:27:57.280976 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:57.280631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"408b4995311a8ef99cab9fce673f58c891914c2c6c7158b896572697721f5816"} Jun 11 19:27:58.290079 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290043 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"041fbdca6f59fa1ab93288b41764c4100a96d375925fb6107419345a52d3c91e"} Jun 11 19:27:58.290526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290108 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"bce1cc43a6564fc28a5483d793b747f7702624cc4577d5fef0892b47e5629295"} Jun 11 19:27:58.290526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290143 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"139defef351307eb6e3efe2e50b2322ab6c7e24580f065eea51acd6dc7af6b22"} Jun 11 19:27:58.290526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"af7afebbb22bc5fb8830db99267a5feb936f0629c07f5bd1e51ab2d535ec8d9d"} Jun 11 19:27:58.290526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290198 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"fe19bb4cd1ccc4e6b372be6c72b4b5982ac5d9a692dc2cbdabf596234b5d2a11"} Jun 11 19:27:58.290526 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.290220 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7e7dd384-0eec-4d79-87a1-c1b232432d87","Type":"ContainerStarted","Data":"328be112aa1173542fadbfd6485098c201e6101ec7eea583bb006c7299c426bc"} Jun 11 19:27:58.325955 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:27:58.325877 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.309372803 podStartE2EDuration="2.325856161s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.483358ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:58.322932867 +0000 UTC m=+311.656986113" watchObservedRunningTime="2026-06-11 19:27:58.325856161 +0000 UTC m=+311.659909431" Jun 11 19:28:04.633858 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.633824 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:28:04.636176 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.636155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.654989 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.654960 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:28:04.748439 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748398 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748583 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjg9p\" (UniqueName: \"kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748634 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748793 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748706 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.748793 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.748732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjg9p\" (UniqueName: \"kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850396 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850429 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.850575 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.850455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.851112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.851073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.851112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.851097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.851112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.851073 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.851593 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.851564 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.852899 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.852879 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.852988 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.852924 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.859499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.859477 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjg9p\" (UniqueName: \"kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p\") pod \"console-66f5b49c68-5sgvs\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:04.947438 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:04.947318 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:05.087914 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.087893 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:28:05.089440 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:28:05.089410 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dc63847_c87f_4c98_8f2b_f58cbccde8ae.slice/crio-d9b3d8973ed631eecab01752fe43a6c4f9e1abc3a51ba39ea1e7b0031e01a086 WatchSource:0}: Error finding container d9b3d8973ed631eecab01752fe43a6c4f9e1abc3a51ba39ea1e7b0031e01a086: Status 404 returned error can't find the container with id d9b3d8973ed631eecab01752fe43a6c4f9e1abc3a51ba39ea1e7b0031e01a086 Jun 11 19:28:05.228267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.228175 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-699fb899bf-rzvt9" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" containerID="cri-o://d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a" gracePeriod=15 Jun 11 19:28:05.321556 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.321512 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5b49c68-5sgvs" event={"ID":"5dc63847-c87f-4c98-8f2b-f58cbccde8ae","Type":"ContainerStarted","Data":"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3"} Jun 11 19:28:05.321732 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.321572 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5b49c68-5sgvs" event={"ID":"5dc63847-c87f-4c98-8f2b-f58cbccde8ae","Type":"ContainerStarted","Data":"d9b3d8973ed631eecab01752fe43a6c4f9e1abc3a51ba39ea1e7b0031e01a086"} Jun 11 19:28:05.469672 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.469643 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:28:05.494871 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.494773 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f5b49c68-5sgvs" podStartSLOduration=1.494756034 podStartE2EDuration="1.494756034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:28:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:28:05.344554523 +0000 UTC m=+318.678607767" watchObservedRunningTime="2026-06-11 19:28:05.494756034 +0000 UTC m=+318.828809280" Jun 11 19:28:05.556804 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.556765 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.556964 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.556858 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bdpf\" (UniqueName: \"kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.556964 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.556912 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.557048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.556976 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.557048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557001 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.557048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557036 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert\") pod \"66e31c39-d9f2-4cae-aae1-21fda55fa989\" (UID: \"66e31c39-d9f2-4cae-aae1-21fda55fa989\") " Jun 11 19:28:05.557244 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557221 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca" (OuterVolumeSpecName: "service-ca") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:05.557311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557281 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:05.557485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557440 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:05.557485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557452 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config" (OuterVolumeSpecName: "console-config") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:05.557485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.557464 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:05.559431 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.559409 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:05.559679 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.559655 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:05.559804 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.559784 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf" (OuterVolumeSpecName: "kube-api-access-7bdpf") pod "66e31c39-d9f2-4cae-aae1-21fda55fa989" (UID: "66e31c39-d9f2-4cae-aae1-21fda55fa989"). InnerVolumeSpecName "kube-api-access-7bdpf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:28:05.658030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.657992 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:05.658030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.658021 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:05.658030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.658031 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66e31c39-d9f2-4cae-aae1-21fda55fa989-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:05.658030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:05.658039 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bdpf\" (UniqueName: \"kubernetes.io/projected/66e31c39-d9f2-4cae-aae1-21fda55fa989-kube-api-access-7bdpf\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:06.326716 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.326681 2577 generic.go:356] "Generic (PLEG): container finished" podID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerID="d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a" exitCode=0 Jun 11 19:28:06.326917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.326722 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-699fb899bf-rzvt9" Jun 11 19:28:06.326917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.326767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699fb899bf-rzvt9" event={"ID":"66e31c39-d9f2-4cae-aae1-21fda55fa989","Type":"ContainerDied","Data":"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a"} Jun 11 19:28:06.326917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.326813 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-699fb899bf-rzvt9" event={"ID":"66e31c39-d9f2-4cae-aae1-21fda55fa989","Type":"ContainerDied","Data":"6443b58a66d36051432dfd2304db8e376c5734efabdd3f5a984a0b51ee07ce89"} Jun 11 19:28:06.326917 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.326835 2577 scope.go:117] "RemoveContainer" containerID="d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a" Jun 11 19:28:06.335765 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.335750 2577 scope.go:117] "RemoveContainer" containerID="d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a" Jun 11 19:28:06.336020 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:06.336003 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a\": container with ID starting with d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a not found: ID does not exist" containerID="d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a" Jun 11 19:28:06.336069 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.336028 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a"} err="failed to get container status \"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a\": rpc error: code = NotFound desc = could not find container \"d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a\": container with ID starting with d83f8afa86979ee646145b5c19de15bce7ef9f369fb9f9bdcb91d29e1b20cb2a not found: ID does not exist" Jun 11 19:28:06.347560 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.347534 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:28:06.352175 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:06.352151 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-699fb899bf-rzvt9"] Jun 11 19:28:07.110660 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:07.110632 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" path="/var/lib/kubelet/pods/66e31c39-d9f2-4cae-aae1-21fda55fa989/volumes" Jun 11 19:28:14.947661 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:14.947630 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:14.948155 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:14.947707 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:14.952221 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:14.952192 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:15.377538 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:15.377508 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:28:15.429816 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:15.429781 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:28:17.770904 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.770869 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:17.771321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771162 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="prometheus" containerID="cri-o://6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" gracePeriod=600 Jun 11 19:28:17.771321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771187 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy" containerID="cri-o://6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" gracePeriod=600 Jun 11 19:28:17.771321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771254 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-web" containerID="cri-o://12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" gracePeriod=600 Jun 11 19:28:17.771321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771244 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="thanos-sidecar" containerID="cri-o://9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" gracePeriod=600 Jun 11 19:28:17.771523 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771268 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="config-reloader" containerID="cri-o://0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" gracePeriod=600 Jun 11 19:28:17.771523 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:17.771249 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" gracePeriod=600 Jun 11 19:28:18.015582 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.015558 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.164383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164240 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164383 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164340 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164422 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164466 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d85jc\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164507 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164561 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164614 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164595 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164658 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164706 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164759 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164783 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164817 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164845 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.164863 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164848 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164876 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164906 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164936 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.164977 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.165002 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.165038 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0\") pod \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\" (UID: \"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43\") " Jun 11 19:28:18.165557 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.165316 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.165705 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.165607 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.166161 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.166077 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.166386 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.166313 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.167580 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.167318 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.167799 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.167774 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.167915 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.167896 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.167996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.167907 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.167996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.167975 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out" (OuterVolumeSpecName: "config-out") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:28:18.168687 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.168658 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc" (OuterVolumeSpecName: "kube-api-access-d85jc") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "kube-api-access-d85jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:28:18.169014 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.168989 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:18.169107 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.169006 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.169107 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.169097 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:28:18.169220 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.169187 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.169816 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.169786 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.169900 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.169876 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:28:18.170387 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.170342 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.170870 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.170855 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.171113 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.171096 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config" (OuterVolumeSpecName: "config") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.180205 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.180181 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config" (OuterVolumeSpecName: "web-config") pod "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" (UID: "ae5fafb4-38f4-4ff0-be7f-07917a5f4b43"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:18.266046 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266007 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-db\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266046 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266040 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-kube-rbac-proxy\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266046 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266053 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266067 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266081 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-web-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266092 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d85jc\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-kube-api-access-d85jc\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266103 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config-out\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266114 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266126 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266137 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266149 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-tls-assets\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266160 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266170 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266183 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266195 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-configmap-metrics-client-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266207 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266220 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266231 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-grpc-tls\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.266320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.266243 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43-secret-metrics-client-certs\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:18.389853 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389821 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" exitCode=0 Jun 11 19:28:18.389853 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389846 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" exitCode=0 Jun 11 19:28:18.389853 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389852 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" exitCode=0 Jun 11 19:28:18.389853 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389857 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" exitCode=0 Jun 11 19:28:18.389853 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389862 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" exitCode=0 Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389867 2577 generic.go:356] "Generic (PLEG): container finished" podID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" exitCode=0 Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389909 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.389908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390100 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390170 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} Jun 11 19:28:18.390224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390212 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} Jun 11 19:28:18.390658 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.390251 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ae5fafb4-38f4-4ff0-be7f-07917a5f4b43","Type":"ContainerDied","Data":"3ba96ce9dbc53c5e91a68fe721adb30693c51528d5a4981b9e2b2057ac435f8e"} Jun 11 19:28:18.398584 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.398563 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.406285 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.406270 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.413719 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.413698 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.414948 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.414930 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:18.418563 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.418544 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:18.421291 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.421276 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.428838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.428818 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.438533 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.437228 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.446441 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.446421 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.446705 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.446688 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.446748 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.446715 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.446748 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.446746 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.446986 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.446970 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.447030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.446993 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.447030 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447008 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.447259 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.447243 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.447295 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447265 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.447295 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447280 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.447532 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.447509 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.447581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447536 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.447581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447548 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.447781 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.447765 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.447818 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447785 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.447818 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.447798 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.448029 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.447996 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.448120 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448031 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.448120 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448049 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.448471 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:18.448450 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.448621 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448476 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.448621 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448494 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.448998 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448961 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.448998 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.448992 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.450875 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.450852 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:18.451310 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451293 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="prometheus" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451313 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="prometheus" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451331 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451340 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451368 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-web" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451376 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-web" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451391 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-thanos" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451398 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-thanos" Jun 11 19:28:18.451412 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451412 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="config-reloader" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451420 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="config-reloader" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451430 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="thanos-sidecar" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451438 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="thanos-sidecar" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451458 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="init-config-reloader" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451465 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="init-config-reloader" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451476 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451483 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451558 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-thanos" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451569 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e31c39-d9f2-4cae-aae1-21fda55fa989" containerName="console" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451583 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451594 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="prometheus" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451604 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="config-reloader" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451612 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="kube-rbac-proxy-web" Jun 11 19:28:18.451784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.451621 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" containerName="thanos-sidecar" Jun 11 19:28:18.453630 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.453603 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.453727 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.453631 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.453909 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.453881 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.453994 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.453911 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.454210 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454192 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.454293 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454212 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.454510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454493 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.454610 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454512 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.454804 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454781 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.454910 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.454806 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.455111 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455085 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.455174 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455113 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.455429 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455330 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.455527 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455429 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.455663 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455643 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.455700 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455665 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.455900 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455879 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.455900 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.455899 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.456114 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456094 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.456164 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456115 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.456308 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456293 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.456388 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456314 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.456577 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456548 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.456654 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456581 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.456843 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456823 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.456843 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.456842 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.457044 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457026 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.457402 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457385 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.457640 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457623 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.457686 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457643 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.457727 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.458097 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457892 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.458097 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.457923 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.458321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458297 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.458410 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458324 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.458610 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458593 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.458610 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458609 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.458843 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458820 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.458921 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.458844 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.459065 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459048 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.459113 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459067 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.459274 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459251 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.459317 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459278 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.459569 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459546 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.459724 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459570 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.459844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459790 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.459844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459809 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.459844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459825 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 19:28:18.459844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.459835 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 19:28:18.460178 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460022 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.460178 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460044 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460178 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460220 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460220 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460307 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460220 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x987f\"" Jun 11 19:28:18.460453 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460327 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460474 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460577 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-42bknvegvrreh\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460615 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460639 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460658 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460668 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460764 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460846 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460883 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.460982 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460899 2577 scope.go:117] "RemoveContainer" containerID="9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def" Jun 11 19:28:18.461620 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.460997 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 19:28:18.461620 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461169 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def"} err="failed to get container status \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": rpc error: code = NotFound desc = could not find container \"9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def\": container with ID starting with 9669111b0d6652231d6195d21d4d5655006d34ce03bf6ddcf715196f2f359def not found: ID does not exist" Jun 11 19:28:18.461620 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461194 2577 scope.go:117] "RemoveContainer" containerID="6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac" Jun 11 19:28:18.461620 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461425 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac"} err="failed to get container status \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": rpc error: code = NotFound desc = could not find container \"6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac\": container with ID starting with 6c890c9b9a88239101fadc2006b568c503902ab9b2b1addba99a9c6cb9b549ac not found: ID does not exist" Jun 11 19:28:18.461620 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461449 2577 scope.go:117] "RemoveContainer" containerID="12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40" Jun 11 19:28:18.461878 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461625 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40"} err="failed to get container status \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": rpc error: code = NotFound desc = could not find container \"12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40\": container with ID starting with 12914df845be6aa63c068e270b2fe9cb2d0f3f7bd65cc786401b55d52816ce40 not found: ID does not exist" Jun 11 19:28:18.461878 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461643 2577 scope.go:117] "RemoveContainer" containerID="9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b" Jun 11 19:28:18.461878 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461868 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b"} err="failed to get container status \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": rpc error: code = NotFound desc = could not find container \"9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b\": container with ID starting with 9cc16b65da68ba6f8b5a045ba10fa507019988c150c15ee191080a66ca4c1a3b not found: ID does not exist" Jun 11 19:28:18.462057 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.461885 2577 scope.go:117] "RemoveContainer" containerID="0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02" Jun 11 19:28:18.462121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.462070 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02"} err="failed to get container status \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": rpc error: code = NotFound desc = could not find container \"0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02\": container with ID starting with 0fb5d4610bea8fef5cc2b9b2a131841463e7be83d08596e42bcaa86dbbf49b02 not found: ID does not exist" Jun 11 19:28:18.462121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.462087 2577 scope.go:117] "RemoveContainer" containerID="6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944" Jun 11 19:28:18.462267 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.462248 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944"} err="failed to get container status \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": rpc error: code = NotFound desc = could not find container \"6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944\": container with ID starting with 6f2dd81a023a9186db32b5dea8c8add7fad26dd2fd3def908554420e568c2944 not found: ID does not exist" Jun 11 19:28:18.462331 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.462269 2577 scope.go:117] "RemoveContainer" containerID="2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695" Jun 11 19:28:18.462491 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.462461 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695"} err="failed to get container status \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": rpc error: code = NotFound desc = could not find container \"2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695\": container with ID starting with 2a0a10f48296f06b8fd56137792b2298a1ffc3d6c4f2d4612683c93fbde84695 not found: ID does not exist" Jun 11 19:28:18.465078 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.465062 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 19:28:18.467921 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.467890 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 19:28:18.473226 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.473204 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:18.568689 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568657 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568694 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568714 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568731 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568827 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.568852 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88qxp\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-kube-api-access-88qxp\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569040 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.568999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569036 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569073 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569092 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569119 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.569213 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.569198 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.669715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.669715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.669715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669717 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669738 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88qxp\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-kube-api-access-88qxp\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669841 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669924 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669948 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.669980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670005 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670066 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670081 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670160 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670199 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670223 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670248 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.670675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670498 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.671009 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.670980 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.671428 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.671401 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.671428 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.671417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.672211 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.671895 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.673129 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.672952 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config-out\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.673129 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.673105 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.673395 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.673373 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.673477 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.673450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.673545 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.673523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.674061 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.673994 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.674193 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.674167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.674409 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.674385 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.674717 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.674697 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.675745 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.675725 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.675894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.675877 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.676039 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.676021 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2c05a6a1-53dc-4234-9189-dd6f12dfe243-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.676071 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.676043 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c05a6a1-53dc-4234-9189-dd6f12dfe243-web-config\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.678792 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.678776 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88qxp\" (UniqueName: \"kubernetes.io/projected/2c05a6a1-53dc-4234-9189-dd6f12dfe243-kube-api-access-88qxp\") pod \"prometheus-k8s-0\" (UID: \"2c05a6a1-53dc-4234-9189-dd6f12dfe243\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.768174 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.768139 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:18.918003 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:18.917974 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 19:28:18.919624 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:28:18.919598 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c05a6a1_53dc_4234_9189_dd6f12dfe243.slice/crio-081b1cb512a09a0b8c6d77ae52f47b674b98bfe88abc301c872c7a232f23437c WatchSource:0}: Error finding container 081b1cb512a09a0b8c6d77ae52f47b674b98bfe88abc301c872c7a232f23437c: Status 404 returned error can't find the container with id 081b1cb512a09a0b8c6d77ae52f47b674b98bfe88abc301c872c7a232f23437c Jun 11 19:28:19.110630 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:19.110603 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5fafb4-38f4-4ff0-be7f-07917a5f4b43" path="/var/lib/kubelet/pods/ae5fafb4-38f4-4ff0-be7f-07917a5f4b43/volumes" Jun 11 19:28:19.396666 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:19.396632 2577 generic.go:356] "Generic (PLEG): container finished" podID="2c05a6a1-53dc-4234-9189-dd6f12dfe243" containerID="5e294fbf6705c7b6a9818660918af75e00bb2937a6ed0a1ec79921a6afc86ac7" exitCode=0 Jun 11 19:28:19.396840 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:19.396677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerDied","Data":"5e294fbf6705c7b6a9818660918af75e00bb2937a6ed0a1ec79921a6afc86ac7"} Jun 11 19:28:19.396840 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:19.396727 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"081b1cb512a09a0b8c6d77ae52f47b674b98bfe88abc301c872c7a232f23437c"} Jun 11 19:28:20.405761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405724 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"5ed94f7d086a84a823c938533c3bda1be8c1de767462224278303b61a6df3537"} Jun 11 19:28:20.406127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405786 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"9ea352d84252a989eaede9bd616ff8e84f8442762ffed3e2a92bfdc058bd74ad"} Jun 11 19:28:20.406127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"62f5d285b326370b421c2f1ba157d0c9639db3a16c1a1317c0a0b283f2898c98"} Jun 11 19:28:20.406127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"88968cf2cff0d793f29ceebd13f23a71563a962f87e131d5d017065cee921c8a"} Jun 11 19:28:20.406127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405858 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"9877705ce2fcee32df19cccc98d5126112253ed009ff9a84fc0c8410649da05f"} Jun 11 19:28:20.406127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.405883 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2c05a6a1-53dc-4234-9189-dd6f12dfe243","Type":"ContainerStarted","Data":"9a4a226a3dc91a670e7e45b083a8031e718d0fcd6fa514cda40e4e4162da4273"} Jun 11 19:28:20.441266 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:20.441204 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.422688227 podStartE2EDuration="2.441183263s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.495036ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:28:20.438779043 +0000 UTC m=+333.772832287" watchObservedRunningTime="2026-06-11 19:28:20.441183263 +0000 UTC m=+333.775236509" Jun 11 19:28:23.768686 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:23.768646 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:28:40.452174 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.452086 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dc549f776-z5sj5" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" containerID="cri-o://8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c" gracePeriod=15 Jun 11 19:28:40.709832 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.709765 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:28:40.756102 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756070 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk9qw\" (UniqueName: \"kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756211 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756110 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756211 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756182 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756287 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756206 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756287 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756248 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756387 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756285 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756387 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756317 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle\") pod \"0e33a8ea-770d-4632-aacb-bac450c352dd\" (UID: \"0e33a8ea-770d-4632-aacb-bac450c352dd\") " Jun 11 19:28:40.756655 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756628 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:40.756789 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756767 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:40.756873 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756846 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config" (OuterVolumeSpecName: "console-config") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:40.756930 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.756875 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:28:40.758568 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.758541 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:40.758940 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.758913 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:28:40.758940 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.758926 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw" (OuterVolumeSpecName: "kube-api-access-kk9qw") pod "0e33a8ea-770d-4632-aacb-bac450c352dd" (UID: "0e33a8ea-770d-4632-aacb-bac450c352dd"). InnerVolumeSpecName "kube-api-access-kk9qw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:28:40.856997 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.856974 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.856997 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.856995 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk9qw\" (UniqueName: \"kubernetes.io/projected/0e33a8ea-770d-4632-aacb-bac450c352dd-kube-api-access-kk9qw\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.857119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.857005 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.857119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.857013 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.857119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.857022 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.857119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.857030 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e33a8ea-770d-4632-aacb-bac450c352dd-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:40.857119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:40.857037 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e33a8ea-770d-4632-aacb-bac450c352dd-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:28:41.501502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.501419 2577 generic.go:356] "Generic (PLEG): container finished" podID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerID="8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c" exitCode=0 Jun 11 19:28:41.501502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.501477 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc549f776-z5sj5" Jun 11 19:28:41.501502 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.501493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc549f776-z5sj5" event={"ID":"0e33a8ea-770d-4632-aacb-bac450c352dd","Type":"ContainerDied","Data":"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c"} Jun 11 19:28:41.501955 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.501533 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc549f776-z5sj5" event={"ID":"0e33a8ea-770d-4632-aacb-bac450c352dd","Type":"ContainerDied","Data":"4551ed8b24981b618deafc9b385d6aa6639a982d770eab8a647e9f205be48ee6"} Jun 11 19:28:41.501955 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.501553 2577 scope.go:117] "RemoveContainer" containerID="8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c" Jun 11 19:28:41.509913 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.509897 2577 scope.go:117] "RemoveContainer" containerID="8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c" Jun 11 19:28:41.510177 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:28:41.510160 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c\": container with ID starting with 8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c not found: ID does not exist" containerID="8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c" Jun 11 19:28:41.510222 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.510186 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c"} err="failed to get container status \"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c\": rpc error: code = NotFound desc = could not find container \"8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c\": container with ID starting with 8e47cfff9f51526067a67abfdc9931fac081fc1eb850ae41ad6f344e2ad2fa5c not found: ID does not exist" Jun 11 19:28:41.519622 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.519599 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:28:41.523494 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:41.523473 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc549f776-z5sj5"] Jun 11 19:28:43.110664 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:28:43.110630 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" path="/var/lib/kubelet/pods/0e33a8ea-770d-4632-aacb-bac450c352dd/volumes" Jun 11 19:29:18.768468 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:18.768432 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:29:18.784779 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:18.784751 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:29:19.672345 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:19.672315 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 19:29:52.705197 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.705162 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:29:52.705716 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.705558 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" Jun 11 19:29:52.705716 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.705573 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" Jun 11 19:29:52.705716 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.705635 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e33a8ea-770d-4632-aacb-bac450c352dd" containerName="console" Jun 11 19:29:52.708548 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.708527 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.721136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.721110 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:29:52.754888 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.754864 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755002 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.754897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755002 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.754957 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkbjf\" (UniqueName: \"kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755002 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.754995 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.755023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.755059 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.755164 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.755112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855714 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855807 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855823 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.855897 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.855864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkbjf\" (UniqueName: \"kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.856570 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.856533 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.856781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.856551 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.856881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.856612 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.856881 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.856757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.858419 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.858400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.858498 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.858460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:52.864830 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:52.864810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkbjf\" (UniqueName: \"kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf\") pod \"console-85d95788b8-5w9s5\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:53.017838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:53.017807 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:29:53.170409 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:53.170211 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:29:53.173148 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:29:53.173117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod866009df_3b24_4bda_a450_818386f7911e.slice/crio-66b40c54aa9ec71b266840d33a5e6508d25865f5d118f8ec2b12c781045e4eb9 WatchSource:0}: Error finding container 66b40c54aa9ec71b266840d33a5e6508d25865f5d118f8ec2b12c781045e4eb9: Status 404 returned error can't find the container with id 66b40c54aa9ec71b266840d33a5e6508d25865f5d118f8ec2b12c781045e4eb9 Jun 11 19:29:53.798451 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:53.798413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d95788b8-5w9s5" event={"ID":"866009df-3b24-4bda-a450-818386f7911e","Type":"ContainerStarted","Data":"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b"} Jun 11 19:29:53.798799 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:53.798491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d95788b8-5w9s5" event={"ID":"866009df-3b24-4bda-a450-818386f7911e","Type":"ContainerStarted","Data":"66b40c54aa9ec71b266840d33a5e6508d25865f5d118f8ec2b12c781045e4eb9"} Jun 11 19:29:53.818865 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:29:53.818816 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d95788b8-5w9s5" podStartSLOduration=1.8188019130000002 podStartE2EDuration="1.818801913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:29:53.816741071 +0000 UTC m=+427.150794317" watchObservedRunningTime="2026-06-11 19:29:53.818801913 +0000 UTC m=+427.152855159" Jun 11 19:30:03.018710 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:03.018670 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:30:03.019170 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:03.018728 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:30:03.023542 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:03.023516 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:30:03.846486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:03.846457 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:30:03.900329 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:03.900292 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:30:28.927266 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:28.927229 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66f5b49c68-5sgvs" podUID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" containerName="console" containerID="cri-o://9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3" gracePeriod=15 Jun 11 19:30:29.177692 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.177627 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:30:29.178201 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178185 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178250 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178216 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178250 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178247 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178362 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178268 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178458 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178435 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178577 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178478 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjg9p\" (UniqueName: \"kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178577 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config\") pod \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\" (UID: \"5dc63847-c87f-4c98-8f2b-f58cbccde8ae\") " Jun 11 19:30:29.178691 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178592 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:30:29.178778 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178751 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca" (OuterVolumeSpecName: "service-ca") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:30:29.178906 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178839 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.178906 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178863 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.178906 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.178839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:30:29.179128 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.179049 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config" (OuterVolumeSpecName: "console-config") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:30:29.180562 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.180528 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:30:29.180562 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.180550 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:30:29.180719 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.180593 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p" (OuterVolumeSpecName: "kube-api-access-mjg9p") pod "5dc63847-c87f-4c98-8f2b-f58cbccde8ae" (UID: "5dc63847-c87f-4c98-8f2b-f58cbccde8ae"). InnerVolumeSpecName "kube-api-access-mjg9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:30:29.279797 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.279756 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.279797 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.279788 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.279797 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.279797 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjg9p\" (UniqueName: \"kubernetes.io/projected/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-kube-api-access-mjg9p\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.279797 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.279808 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.280060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.279817 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5dc63847-c87f-4c98-8f2b-f58cbccde8ae-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:30:29.950549 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.950511 2577 generic.go:356] "Generic (PLEG): container finished" podID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" containerID="9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3" exitCode=0 Jun 11 19:30:29.950999 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.950555 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f5b49c68-5sgvs" Jun 11 19:30:29.950999 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.950585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5b49c68-5sgvs" event={"ID":"5dc63847-c87f-4c98-8f2b-f58cbccde8ae","Type":"ContainerDied","Data":"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3"} Jun 11 19:30:29.950999 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.950639 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f5b49c68-5sgvs" event={"ID":"5dc63847-c87f-4c98-8f2b-f58cbccde8ae","Type":"ContainerDied","Data":"d9b3d8973ed631eecab01752fe43a6c4f9e1abc3a51ba39ea1e7b0031e01a086"} Jun 11 19:30:29.950999 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.950667 2577 scope.go:117] "RemoveContainer" containerID="9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3" Jun 11 19:30:29.959532 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.959517 2577 scope.go:117] "RemoveContainer" containerID="9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3" Jun 11 19:30:29.959801 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:30:29.959785 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3\": container with ID starting with 9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3 not found: ID does not exist" containerID="9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3" Jun 11 19:30:29.959843 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.959810 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3"} err="failed to get container status \"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3\": rpc error: code = NotFound desc = could not find container \"9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3\": container with ID starting with 9ce38b2e5dd13569bb6aa1063f4c7cb62682e5890d4b89c0b3e7ac3cd0a459a3 not found: ID does not exist" Jun 11 19:30:29.971413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.971389 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:30:29.974946 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:29.974921 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f5b49c68-5sgvs"] Jun 11 19:30:31.110428 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:30:31.110389 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" path="/var/lib/kubelet/pods/5dc63847-c87f-4c98-8f2b-f58cbccde8ae/volumes" Jun 11 19:31:01.387972 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.387938 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc"] Jun 11 19:31:01.388486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.388275 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" containerName="console" Jun 11 19:31:01.388486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.388286 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" containerName="console" Jun 11 19:31:01.388486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.388364 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dc63847-c87f-4c98-8f2b-f58cbccde8ae" containerName="console" Jun 11 19:31:01.392415 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.392393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.394983 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.394960 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-98gtm\"" Jun 11 19:31:01.395303 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.395278 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 19:31:01.395447 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.395377 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 19:31:01.407157 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.407133 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc"] Jun 11 19:31:01.467447 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.467407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.467447 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.467448 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z6mc\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-kube-api-access-8z6mc\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.568048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.568012 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.568048 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.568045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z6mc\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-kube-api-access-8z6mc\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.586198 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.586167 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.586326 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.586239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z6mc\" (UniqueName: \"kubernetes.io/projected/74661815-b483-40a4-8ff8-f5c5e68de30c-kube-api-access-8z6mc\") pod \"cert-manager-cainjector-5d99449ffd-9d2jc\" (UID: \"74661815-b483-40a4-8ff8-f5c5e68de30c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.709665 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.709569 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" Jun 11 19:31:01.838680 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.838654 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc"] Jun 11 19:31:01.841416 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:31:01.841391 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74661815_b483_40a4_8ff8_f5c5e68de30c.slice/crio-bfc489c182ee1f5d5a0f6228f12aa52bddb4de8c34f1df525b05398e59f6ea99 WatchSource:0}: Error finding container bfc489c182ee1f5d5a0f6228f12aa52bddb4de8c34f1df525b05398e59f6ea99: Status 404 returned error can't find the container with id bfc489c182ee1f5d5a0f6228f12aa52bddb4de8c34f1df525b05398e59f6ea99 Jun 11 19:31:01.843812 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:01.843794 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:31:02.091994 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:02.091962 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" event={"ID":"74661815-b483-40a4-8ff8-f5c5e68de30c","Type":"ContainerStarted","Data":"bfc489c182ee1f5d5a0f6228f12aa52bddb4de8c34f1df525b05398e59f6ea99"} Jun 11 19:31:06.117806 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:06.117770 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" event={"ID":"74661815-b483-40a4-8ff8-f5c5e68de30c","Type":"ContainerStarted","Data":"5afe91396f1908672b896b339e02f62a089c941128c848db86d9893797b11a0f"} Jun 11 19:31:06.135454 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:06.135406 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-9d2jc" podStartSLOduration=1.78704033 podStartE2EDuration="5.13539173s" totalImagesPullingTime="3.3483514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:06.133459025 +0000 UTC m=+499.467512286" watchObservedRunningTime="2026-06-11 19:31:06.13539173 +0000 UTC m=+499.469444974" Jun 11 19:31:18.379054 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.379024 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-7z8g8"] Jun 11 19:31:18.382568 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.382549 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.384968 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.384948 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ft4v2\"" Jun 11 19:31:18.393271 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.393247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-7z8g8"] Jun 11 19:31:18.418405 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.418377 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbhcm\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-kube-api-access-xbhcm\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.418514 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.418424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-bound-sa-token\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.518890 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.518858 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-bound-sa-token\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.519062 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.518938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbhcm\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-kube-api-access-xbhcm\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.527672 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.527646 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-bound-sa-token\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.527938 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.527913 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbhcm\" (UniqueName: \"kubernetes.io/projected/3fb2afcf-2068-4738-b847-0fa699400f5f-kube-api-access-xbhcm\") pod \"cert-manager-59c77684cc-7z8g8\" (UID: \"3fb2afcf-2068-4738-b847-0fa699400f5f\") " pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.691788 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.691692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-7z8g8" Jun 11 19:31:18.825438 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:18.825303 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-7z8g8"] Jun 11 19:31:18.828447 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:31:18.828417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fb2afcf_2068_4738_b847_0fa699400f5f.slice/crio-4a30162d54a6b604a6cc9be928a80628a8f6ba6f9ef1a0c3ed7fd783d2a01107 WatchSource:0}: Error finding container 4a30162d54a6b604a6cc9be928a80628a8f6ba6f9ef1a0c3ed7fd783d2a01107: Status 404 returned error can't find the container with id 4a30162d54a6b604a6cc9be928a80628a8f6ba6f9ef1a0c3ed7fd783d2a01107 Jun 11 19:31:19.174011 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:19.173977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-7z8g8" event={"ID":"3fb2afcf-2068-4738-b847-0fa699400f5f","Type":"ContainerStarted","Data":"3e258f84ffa7afd26405812ef834c5ea0ff9bcb905c21895ebfd7b0e06487c4c"} Jun 11 19:31:19.174011 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:19.174016 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-7z8g8" event={"ID":"3fb2afcf-2068-4738-b847-0fa699400f5f","Type":"ContainerStarted","Data":"4a30162d54a6b604a6cc9be928a80628a8f6ba6f9ef1a0c3ed7fd783d2a01107"} Jun 11 19:31:19.193682 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:19.193630 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-7z8g8" podStartSLOduration=1.193613093 podStartE2EDuration="1.193613093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:19.19207292 +0000 UTC m=+512.526126162" watchObservedRunningTime="2026-06-11 19:31:19.193613093 +0000 UTC m=+512.527666337" Jun 11 19:31:34.030484 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.030405 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv"] Jun 11 19:31:34.033736 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.033716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.036047 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.036025 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 19:31:34.036269 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.036253 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kmkd4\"" Jun 11 19:31:34.036504 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.036491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 19:31:34.036880 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.036862 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 19:31:34.036931 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.036869 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 19:31:34.057845 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.057812 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv"] Jun 11 19:31:34.156864 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.156829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.157039 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.156943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.157039 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.156987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.157039 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.157034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dv7\" (UniqueName: \"kubernetes.io/projected/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-kube-api-access-v4dv7\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.157211 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.157103 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258226 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dv7\" (UniqueName: \"kubernetes.io/projected/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-kube-api-access-v4dv7\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258249 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258415 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.258778 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.258758 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.260455 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.260423 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.260840 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.260819 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.260928 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.260866 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.267421 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.267398 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dv7\" (UniqueName: \"kubernetes.io/projected/75e5b3f8-42cf-49a7-b481-3cf7b3b080da-kube-api-access-v4dv7\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-5zrcv\" (UID: \"75e5b3f8-42cf-49a7-b481-3cf7b3b080da\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.348137 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.348042 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:34.490088 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:34.490054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv"] Jun 11 19:31:34.493450 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:31:34.493417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e5b3f8_42cf_49a7_b481_3cf7b3b080da.slice/crio-bacead4abd0e20c4f478c2d166aeb06ffb67d68dab39e5e059dba7bbddc3c7e7 WatchSource:0}: Error finding container bacead4abd0e20c4f478c2d166aeb06ffb67d68dab39e5e059dba7bbddc3c7e7: Status 404 returned error can't find the container with id bacead4abd0e20c4f478c2d166aeb06ffb67d68dab39e5e059dba7bbddc3c7e7 Jun 11 19:31:35.243127 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:35.243086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" event={"ID":"75e5b3f8-42cf-49a7-b481-3cf7b3b080da","Type":"ContainerStarted","Data":"bacead4abd0e20c4f478c2d166aeb06ffb67d68dab39e5e059dba7bbddc3c7e7"} Jun 11 19:31:38.259417 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:38.259373 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" event={"ID":"75e5b3f8-42cf-49a7-b481-3cf7b3b080da","Type":"ContainerStarted","Data":"c3953cb8483c9e96c719256ae026fdf8eee9ef6b371f429567e2616f7ee34062"} Jun 11 19:31:39.265226 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:39.265189 2577 generic.go:356] "Generic (PLEG): container finished" podID="75e5b3f8-42cf-49a7-b481-3cf7b3b080da" containerID="c3953cb8483c9e96c719256ae026fdf8eee9ef6b371f429567e2616f7ee34062" exitCode=0 Jun 11 19:31:39.265732 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:39.265279 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" event={"ID":"75e5b3f8-42cf-49a7-b481-3cf7b3b080da","Type":"ContainerDied","Data":"c3953cb8483c9e96c719256ae026fdf8eee9ef6b371f429567e2616f7ee34062"} Jun 11 19:31:40.271748 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:40.271710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" event={"ID":"75e5b3f8-42cf-49a7-b481-3cf7b3b080da","Type":"ContainerStarted","Data":"4faedf498f92123398cf5735c789b5042eb92d02cfc126ee3b1c9ea7d8ed35ff"} Jun 11 19:31:40.272137 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:40.271783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:40.295031 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:40.294983 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" podStartSLOduration=3.068109341 podStartE2EDuration="7.294969434s" totalImagesPullingTime="3.237712939s" totalInitContainerRuntime="989.147154ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:40.29409623 +0000 UTC m=+533.628149476" watchObservedRunningTime="2026-06-11 19:31:40.294969434 +0000 UTC m=+533.629022680" Jun 11 19:31:51.278519 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:51.278483 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-5zrcv" Jun 11 19:31:56.187645 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.187610 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q"] Jun 11 19:31:56.196413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.196390 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.201624 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.201599 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 19:31:56.201761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.201655 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bzdbl\"" Jun 11 19:31:56.201761 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.201702 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 19:31:56.201885 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.201611 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 19:31:56.202107 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.202092 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:31:56.202376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.202335 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 19:31:56.214015 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.213992 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q"] Jun 11 19:31:56.363177 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.363146 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.363461 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.363182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.363805 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.363774 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9tns\" (UniqueName: \"kubernetes.io/projected/6c20541e-2285-43c0-992b-394a983ba4b0-kube-api-access-x9tns\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.363936 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.363846 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c20541e-2285-43c0-992b-394a983ba4b0-manager-config\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.465373 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.465263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9tns\" (UniqueName: \"kubernetes.io/projected/6c20541e-2285-43c0-992b-394a983ba4b0-kube-api-access-x9tns\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.465373 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.465305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c20541e-2285-43c0-992b-394a983ba4b0-manager-config\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.465569 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.465377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.465569 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.465411 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.465950 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.465923 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c20541e-2285-43c0-992b-394a983ba4b0-manager-config\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.467916 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.467896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.468002 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.467950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c20541e-2285-43c0-992b-394a983ba4b0-cert\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.492427 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.492403 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9tns\" (UniqueName: \"kubernetes.io/projected/6c20541e-2285-43c0-992b-394a983ba4b0-kube-api-access-x9tns\") pod \"lws-controller-manager-7b7c45796d-4t42q\" (UID: \"6c20541e-2285-43c0-992b-394a983ba4b0\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.506783 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.506761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:31:56.654122 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.654082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q"] Jun 11 19:31:56.657794 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:31:56.657768 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c20541e_2285_43c0_992b_394a983ba4b0.slice/crio-c0132fad6b8baa02b45c3b88a3a20bf998d34356581e5bafb1bfa1064e2e1393 WatchSource:0}: Error finding container c0132fad6b8baa02b45c3b88a3a20bf998d34356581e5bafb1bfa1064e2e1393: Status 404 returned error can't find the container with id c0132fad6b8baa02b45c3b88a3a20bf998d34356581e5bafb1bfa1064e2e1393 Jun 11 19:31:56.719930 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.719859 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw"] Jun 11 19:31:56.724687 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.724665 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.727004 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.726982 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 19:31:56.727486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.727441 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 19:31:56.727486 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.727479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 19:31:56.727696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.727586 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rrvlj\"" Jun 11 19:31:56.727826 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.727811 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 19:31:56.743508 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.743482 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw"] Jun 11 19:31:56.868440 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.868411 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dcpx\" (UniqueName: \"kubernetes.io/projected/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-kube-api-access-5dcpx\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.868594 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.868456 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tmp\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.868594 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.868488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tls-certs\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.969096 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.969068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tmp\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.969249 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.969108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tls-certs\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.969249 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.969194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dcpx\" (UniqueName: \"kubernetes.io/projected/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-kube-api-access-5dcpx\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.971585 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.971519 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tmp\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.971705 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.971690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-tls-certs\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:56.977239 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:56.977219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dcpx\" (UniqueName: \"kubernetes.io/projected/a71bafe8-5f3f-4e8e-91fe-8c4b71491feb-kube-api-access-5dcpx\") pod \"kube-auth-proxy-76b6fb5bf5-lmtcw\" (UID: \"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb\") " pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:57.038177 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:57.038144 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" Jun 11 19:31:57.227613 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:57.227588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw"] Jun 11 19:31:57.230162 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:31:57.230137 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda71bafe8_5f3f_4e8e_91fe_8c4b71491feb.slice/crio-67e9f771adf6c69b0f335f1f84b178726486aa7b180e28936ec4c2a0e40f78c7 WatchSource:0}: Error finding container 67e9f771adf6c69b0f335f1f84b178726486aa7b180e28936ec4c2a0e40f78c7: Status 404 returned error can't find the container with id 67e9f771adf6c69b0f335f1f84b178726486aa7b180e28936ec4c2a0e40f78c7 Jun 11 19:31:57.355346 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:57.355303 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" event={"ID":"6c20541e-2285-43c0-992b-394a983ba4b0","Type":"ContainerStarted","Data":"c0132fad6b8baa02b45c3b88a3a20bf998d34356581e5bafb1bfa1064e2e1393"} Jun 11 19:31:57.357286 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:31:57.357258 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" event={"ID":"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb","Type":"ContainerStarted","Data":"67e9f771adf6c69b0f335f1f84b178726486aa7b180e28936ec4c2a0e40f78c7"} Jun 11 19:32:01.381210 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:01.381170 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" event={"ID":"a71bafe8-5f3f-4e8e-91fe-8c4b71491feb","Type":"ContainerStarted","Data":"315a5a9aa25ba94ddc7d677a153cee1f69007a80b6780089015cdc231bc36f96"} Jun 11 19:32:01.382784 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:01.382755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" event={"ID":"6c20541e-2285-43c0-992b-394a983ba4b0","Type":"ContainerStarted","Data":"d22f9e6ce53e5755b95b59b2db70b36e19317425ca288acebbcab1465b8984e1"} Jun 11 19:32:01.382931 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:01.382841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:32:01.400025 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:01.399975 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76b6fb5bf5-lmtcw" podStartSLOduration=1.9318134869999999 podStartE2EDuration="5.399959775s" totalImagesPullingTime="3.468146288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:01.398290408 +0000 UTC m=+554.732343664" watchObservedRunningTime="2026-06-11 19:32:01.399959775 +0000 UTC m=+554.734013020" Jun 11 19:32:01.418798 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:01.418741 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" podStartSLOduration=1.422550468 podStartE2EDuration="5.418725517s" totalImagesPullingTime="3.996175049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:01.416932693 +0000 UTC m=+554.750985961" watchObservedRunningTime="2026-06-11 19:32:01.418725517 +0000 UTC m=+554.752778762" Jun 11 19:32:12.390691 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:12.390657 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-4t42q" Jun 11 19:32:47.096495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:47.096470 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:32:47.097022 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:32:47.096479 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:33:09.041282 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.041196 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cd85ccb67-xbgnv"] Jun 11 19:33:09.044405 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.044388 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.062786 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.058718 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd85ccb67-xbgnv"] Jun 11 19:33:09.108836 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108815 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-oauth-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.108958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-service-ca\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.108958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108872 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-trusted-ca-bundle\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.108958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-oauth-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.108958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108932 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-console-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.108958 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.108952 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.109168 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.109081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svzgp\" (UniqueName: \"kubernetes.io/projected/d9d946d3-c398-444a-b568-bd972734889f-kube-api-access-svzgp\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209514 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209484 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-console-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209596 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svzgp\" (UniqueName: \"kubernetes.io/projected/d9d946d3-c398-444a-b568-bd972734889f-kube-api-access-svzgp\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-oauth-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209673 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-service-ca\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209696 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-trusted-ca-bundle\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.209911 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.209720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-oauth-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.210376 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.210280 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-console-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.210628 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.210433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-oauth-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.210628 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.210595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-trusted-ca-bundle\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.210750 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.210700 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9d946d3-c398-444a-b568-bd972734889f-service-ca\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.212186 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.212166 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-oauth-config\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.212300 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.212281 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9d946d3-c398-444a-b568-bd972734889f-console-serving-cert\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.221060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.221038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svzgp\" (UniqueName: \"kubernetes.io/projected/d9d946d3-c398-444a-b568-bd972734889f-kube-api-access-svzgp\") pod \"console-5cd85ccb67-xbgnv\" (UID: \"d9d946d3-c398-444a-b568-bd972734889f\") " pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.353645 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.353571 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:09.490589 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.490558 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cd85ccb67-xbgnv"] Jun 11 19:33:09.493598 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:33:09.493572 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d946d3_c398_444a_b568_bd972734889f.slice/crio-0fae3c226c76b02174f2b4ae746cc22725619949884f7170965b28ff6da1d2a3 WatchSource:0}: Error finding container 0fae3c226c76b02174f2b4ae746cc22725619949884f7170965b28ff6da1d2a3: Status 404 returned error can't find the container with id 0fae3c226c76b02174f2b4ae746cc22725619949884f7170965b28ff6da1d2a3 Jun 11 19:33:09.701269 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.701193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd85ccb67-xbgnv" event={"ID":"d9d946d3-c398-444a-b568-bd972734889f","Type":"ContainerStarted","Data":"7385c6c5ed70d0511a611414f6ac82fd29a5f190a552e25988599a09fc91b35b"} Jun 11 19:33:09.701269 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.701247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cd85ccb67-xbgnv" event={"ID":"d9d946d3-c398-444a-b568-bd972734889f","Type":"ContainerStarted","Data":"0fae3c226c76b02174f2b4ae746cc22725619949884f7170965b28ff6da1d2a3"} Jun 11 19:33:09.721316 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:09.721270 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cd85ccb67-xbgnv" podStartSLOduration=0.721255486 podStartE2EDuration="721.255486ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:33:09.719105381 +0000 UTC m=+623.053158626" watchObservedRunningTime="2026-06-11 19:33:09.721255486 +0000 UTC m=+623.055308730" Jun 11 19:33:19.354069 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:19.354039 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:19.354508 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:19.354087 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:19.358920 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:19.358895 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:19.751329 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:19.751256 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cd85ccb67-xbgnv" Jun 11 19:33:19.801289 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:19.801258 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:33:38.391649 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.391620 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2"] Jun 11 19:33:38.394996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.394979 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.397163 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.397142 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 11 19:33:38.397163 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.397153 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 11 19:33:38.397646 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.397627 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9rvd6\"" Jun 11 19:33:38.397734 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.397627 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 19:33:38.397734 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.397632 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 19:33:38.406567 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.406548 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2"] Jun 11 19:33:38.478706 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.478676 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.478820 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.478710 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1248f821-a91b-4cee-9b94-00edc221d987-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.478861 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.478844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqzd\" (UniqueName: \"kubernetes.io/projected/1248f821-a91b-4cee-9b94-00edc221d987-kube-api-access-lbqzd\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.579513 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.579486 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqzd\" (UniqueName: \"kubernetes.io/projected/1248f821-a91b-4cee-9b94-00edc221d987-kube-api-access-lbqzd\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.579609 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.579522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.579609 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.579541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1248f821-a91b-4cee-9b94-00edc221d987-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.579681 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:33:38.579639 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 11 19:33:38.579732 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:33:38.579720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert podName:1248f821-a91b-4cee-9b94-00edc221d987 nodeName:}" failed. No retries permitted until 2026-06-11 19:33:39.079700381 +0000 UTC m=+652.413753607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-vs2c2" (UID: "1248f821-a91b-4cee-9b94-00edc221d987") : secret "plugin-serving-cert" not found Jun 11 19:33:38.580197 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.580181 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1248f821-a91b-4cee-9b94-00edc221d987-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:38.592272 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:38.592247 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqzd\" (UniqueName: \"kubernetes.io/projected/1248f821-a91b-4cee-9b94-00edc221d987-kube-api-access-lbqzd\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:39.084673 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:39.084639 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:39.087278 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:39.087240 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1248f821-a91b-4cee-9b94-00edc221d987-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-vs2c2\" (UID: \"1248f821-a91b-4cee-9b94-00edc221d987\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:39.305606 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:39.305575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" Jun 11 19:33:39.448919 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:39.448897 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2"] Jun 11 19:33:39.451174 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:33:39.451147 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1248f821_a91b_4cee_9b94_00edc221d987.slice/crio-623be3e7786aa734cfba3e391c35086847ad00fa29e08f09969228d54ec67c1b WatchSource:0}: Error finding container 623be3e7786aa734cfba3e391c35086847ad00fa29e08f09969228d54ec67c1b: Status 404 returned error can't find the container with id 623be3e7786aa734cfba3e391c35086847ad00fa29e08f09969228d54ec67c1b Jun 11 19:33:39.852906 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:39.852870 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" event={"ID":"1248f821-a91b-4cee-9b94-00edc221d987","Type":"ContainerStarted","Data":"623be3e7786aa734cfba3e391c35086847ad00fa29e08f09969228d54ec67c1b"} Jun 11 19:33:44.822403 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:44.822335 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85d95788b8-5w9s5" podUID="866009df-3b24-4bda-a450-818386f7911e" containerName="console" containerID="cri-o://22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b" gracePeriod=15 Jun 11 19:33:45.808682 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.808652 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:33:45.889662 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.889623 2577 generic.go:356] "Generic (PLEG): container finished" podID="866009df-3b24-4bda-a450-818386f7911e" containerID="22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b" exitCode=0 Jun 11 19:33:45.890121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.889670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d95788b8-5w9s5" event={"ID":"866009df-3b24-4bda-a450-818386f7911e","Type":"ContainerDied","Data":"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b"} Jun 11 19:33:45.890121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.889701 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d95788b8-5w9s5" Jun 11 19:33:45.890121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.889776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d95788b8-5w9s5" event={"ID":"866009df-3b24-4bda-a450-818386f7911e","Type":"ContainerDied","Data":"66b40c54aa9ec71b266840d33a5e6508d25865f5d118f8ec2b12c781045e4eb9"} Jun 11 19:33:45.890121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.889803 2577 scope.go:117] "RemoveContainer" containerID="22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b" Jun 11 19:33:45.900534 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.900510 2577 scope.go:117] "RemoveContainer" containerID="22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b" Jun 11 19:33:45.900877 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:33:45.900856 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b\": container with ID starting with 22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b not found: ID does not exist" containerID="22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b" Jun 11 19:33:45.900977 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.900888 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b"} err="failed to get container status \"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b\": rpc error: code = NotFound desc = could not find container \"22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b\": container with ID starting with 22cf72450d3916d6f21efe34d875754aa51fa783380c7cf927ea2542776a8e9b not found: ID does not exist" Jun 11 19:33:45.960187 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960094 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960187 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960155 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkbjf\" (UniqueName: \"kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960187 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960184 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960204 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960238 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960273 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960499 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960326 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle\") pod \"866009df-3b24-4bda-a450-818386f7911e\" (UID: \"866009df-3b24-4bda-a450-818386f7911e\") " Jun 11 19:33:45.960731 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960650 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config" (OuterVolumeSpecName: "console-config") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:45.960731 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960653 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:45.960731 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960716 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca" (OuterVolumeSpecName: "service-ca") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:45.960964 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.960905 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:33:45.962556 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.962532 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:45.962664 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.962587 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:33:45.962664 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:45.962623 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf" (OuterVolumeSpecName: "kube-api-access-rkbjf") pod "866009df-3b24-4bda-a450-818386f7911e" (UID: "866009df-3b24-4bda-a450-818386f7911e"). InnerVolumeSpecName "kube-api-access-rkbjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:46.061214 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061174 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-oauth-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061214 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061209 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkbjf\" (UniqueName: \"kubernetes.io/projected/866009df-3b24-4bda-a450-818386f7911e-kube-api-access-rkbjf\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061224 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-oauth-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061237 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-console-config\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061251 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/866009df-3b24-4bda-a450-818386f7911e-console-serving-cert\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061264 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-service-ca\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.061495 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.061277 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/866009df-3b24-4bda-a450-818386f7911e-trusted-ca-bundle\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:33:46.219156 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.219060 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:33:46.227722 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:46.227692 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85d95788b8-5w9s5"] Jun 11 19:33:47.112822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:33:47.112782 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866009df-3b24-4bda-a450-818386f7911e" path="/var/lib/kubelet/pods/866009df-3b24-4bda-a450-818386f7911e/volumes" Jun 11 19:34:03.993822 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:03.993735 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" event={"ID":"1248f821-a91b-4cee-9b94-00edc221d987","Type":"ContainerStarted","Data":"ce8e617b23d63a94f994da986cefb157264e87333c864aa09f81526f10b88ff3"} Jun 11 19:34:04.013896 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:04.013843 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-vs2c2" podStartSLOduration=1.9221096819999999 podStartE2EDuration="26.013828704s" totalImagesPullingTime="24.091719022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:04.012410744 +0000 UTC m=+677.346464020" watchObservedRunningTime="2026-06-11 19:34:04.013828704 +0000 UTC m=+677.347881948" Jun 11 19:34:27.116647 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.116616 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:34:27.117085 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.116956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866009df-3b24-4bda-a450-818386f7911e" containerName="console" Jun 11 19:34:27.117085 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.116968 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="866009df-3b24-4bda-a450-818386f7911e" containerName="console" Jun 11 19:34:27.117085 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.117047 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="866009df-3b24-4bda-a450-818386f7911e" containerName="console" Jun 11 19:34:27.181012 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.180967 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:34:27.181012 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.181015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:34:27.181224 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.181059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.183387 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.183365 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 19:34:27.243899 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.243870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5vlz\" (UniqueName: \"kubernetes.io/projected/59e14ced-ee21-4135-821e-994a52334196-kube-api-access-g5vlz\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.244064 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.243936 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59e14ced-ee21-4135-821e-994a52334196-config-file\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.344653 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.344616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59e14ced-ee21-4135-821e-994a52334196-config-file\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.344836 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.344703 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5vlz\" (UniqueName: \"kubernetes.io/projected/59e14ced-ee21-4135-821e-994a52334196-kube-api-access-g5vlz\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.345331 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.345311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/59e14ced-ee21-4135-821e-994a52334196-config-file\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.354253 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.354230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5vlz\" (UniqueName: \"kubernetes.io/projected/59e14ced-ee21-4135-821e-994a52334196-kube-api-access-g5vlz\") pod \"limitador-limitador-54d6d988d5-mm4z9\" (UID: \"59e14ced-ee21-4135-821e-994a52334196\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.491957 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.491862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:27.630188 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:27.630164 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:34:27.632525 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:34:27.632492 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e14ced_ee21_4135_821e_994a52334196.slice/crio-57174bc2d432a2bed28f0826cd9f678b5be4676a8010c996cd3b4296c5abaffd WatchSource:0}: Error finding container 57174bc2d432a2bed28f0826cd9f678b5be4676a8010c996cd3b4296c5abaffd: Status 404 returned error can't find the container with id 57174bc2d432a2bed28f0826cd9f678b5be4676a8010c996cd3b4296c5abaffd Jun 11 19:34:28.114005 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:28.113969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" event={"ID":"59e14ced-ee21-4135-821e-994a52334196","Type":"ContainerStarted","Data":"57174bc2d432a2bed28f0826cd9f678b5be4676a8010c996cd3b4296c5abaffd"} Jun 11 19:34:31.128590 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:31.128558 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" event={"ID":"59e14ced-ee21-4135-821e-994a52334196","Type":"ContainerStarted","Data":"c15e41b9ccb1ae9ec10a38826e10932d2a4b4229367bdf5f6fadcf0e4d419506"} Jun 11 19:34:31.129056 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:31.128676 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:34:31.162215 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:31.162168 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" podStartSLOduration=1.7042737300000002 podStartE2EDuration="4.162154848s" totalImagesPullingTime="2.457881118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:31.159804568 +0000 UTC m=+704.493857813" watchObservedRunningTime="2026-06-11 19:34:31.162154848 +0000 UTC m=+704.496208093" Jun 11 19:34:42.135005 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:34:42.134932 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mm4z9" Jun 11 19:35:28.662509 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.662478 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:35:28.666157 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.666134 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:28.668322 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.668295 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 19:35:28.668484 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.668342 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 19:35:28.668719 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.668704 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 19:35:28.668767 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.668707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qv8cl\"" Jun 11 19:35:28.674712 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.674688 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:35:28.799008 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.798975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bh8b\" (UniqueName: \"kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b\") pod \"maas-keycloak-0\" (UID: \"d9298cba-ab81-4434-8442-fd1065988576\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:28.900333 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.900297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bh8b\" (UniqueName: \"kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b\") pod \"maas-keycloak-0\" (UID: \"d9298cba-ab81-4434-8442-fd1065988576\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:28.910260 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.910225 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bh8b\" (UniqueName: \"kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b\") pod \"maas-keycloak-0\" (UID: \"d9298cba-ab81-4434-8442-fd1065988576\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:28.976887 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:28.976808 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:29.113970 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:29.113947 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:35:29.116665 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:35:29.116640 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9298cba_ab81_4434_8442_fd1065988576.slice/crio-a9a51601946d7813827407e0fba54e62a6ab3d88b179e977c3b6ceb9f4715aea WatchSource:0}: Error finding container a9a51601946d7813827407e0fba54e62a6ab3d88b179e977c3b6ceb9f4715aea: Status 404 returned error can't find the container with id a9a51601946d7813827407e0fba54e62a6ab3d88b179e977c3b6ceb9f4715aea Jun 11 19:35:29.403548 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:29.403514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d9298cba-ab81-4434-8442-fd1065988576","Type":"ContainerStarted","Data":"a9a51601946d7813827407e0fba54e62a6ab3d88b179e977c3b6ceb9f4715aea"} Jun 11 19:35:34.435651 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:34.435617 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d9298cba-ab81-4434-8442-fd1065988576","Type":"ContainerStarted","Data":"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947"} Jun 11 19:35:34.457854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:34.457808 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.316584765 podStartE2EDuration="6.457793331s" totalImagesPullingTime="5.141208566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:34.455843375 +0000 UTC m=+767.789896620" watchObservedRunningTime="2026-06-11 19:35:34.457793331 +0000 UTC m=+767.791846575" Jun 11 19:35:34.977560 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:34.977521 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:34.979260 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:34.979234 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:35.977227 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:35.977178 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:36.978004 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:36.977952 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:37.978052 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:37.978004 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:38.978300 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:38.977543 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:38.978300 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:38.977882 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:39.978278 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:39.977864 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:40.977546 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:40.977503 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:41.977830 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:41.977771 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:42.977301 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:42.977246 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:43.977177 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:43.977132 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:44.977699 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:44.977652 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:45.978082 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:45.978029 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.37:9000/health/started\": dial tcp 10.133.0.37:9000: connect: connection refused" Jun 11 19:35:47.080009 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:47.079955 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 19:35:47.094875 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:47.094838 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:35:57.086140 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:35:57.086104 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:36:36.838647 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:36:36.838617 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:37:47.137012 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:37:47.136926 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:37:47.138218 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:37:47.138199 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:38:50.160109 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:50.160070 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:50.160659 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:50.160266 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" containerID="cri-o://88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947" gracePeriod=30 Jun 11 19:38:52.203515 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.203490 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.234637 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.234611 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bh8b\" (UniqueName: \"kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b\") pod \"d9298cba-ab81-4434-8442-fd1065988576\" (UID: \"d9298cba-ab81-4434-8442-fd1065988576\") " Jun 11 19:38:52.236799 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.236770 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b" (OuterVolumeSpecName: "kube-api-access-4bh8b") pod "d9298cba-ab81-4434-8442-fd1065988576" (UID: "d9298cba-ab81-4434-8442-fd1065988576"). InnerVolumeSpecName "kube-api-access-4bh8b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:38:52.335659 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.335573 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bh8b\" (UniqueName: \"kubernetes.io/projected/d9298cba-ab81-4434-8442-fd1065988576-kube-api-access-4bh8b\") on node \"ip-10-0-139-23.ec2.internal\" DevicePath \"\"" Jun 11 19:38:52.442216 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.442179 2577 generic.go:356] "Generic (PLEG): container finished" podID="d9298cba-ab81-4434-8442-fd1065988576" containerID="88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947" exitCode=143 Jun 11 19:38:52.442448 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.442229 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.442448 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.442266 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d9298cba-ab81-4434-8442-fd1065988576","Type":"ContainerDied","Data":"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947"} Jun 11 19:38:52.442448 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.442325 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d9298cba-ab81-4434-8442-fd1065988576","Type":"ContainerDied","Data":"a9a51601946d7813827407e0fba54e62a6ab3d88b179e977c3b6ceb9f4715aea"} Jun 11 19:38:52.442448 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.442368 2577 scope.go:117] "RemoveContainer" containerID="88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947" Jun 11 19:38:52.454180 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.454164 2577 scope.go:117] "RemoveContainer" containerID="88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947" Jun 11 19:38:52.454512 ip-10-0-139-23 kubenswrapper[2577]: E0611 19:38:52.454489 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947\": container with ID starting with 88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947 not found: ID does not exist" containerID="88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947" Jun 11 19:38:52.454572 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.454523 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947"} err="failed to get container status \"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947\": rpc error: code = NotFound desc = could not find container \"88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947\": container with ID starting with 88f2d23a171858bfa7cd831e7d70be2f9be8862c6d747f5809b921d017b33947 not found: ID does not exist" Jun 11 19:38:52.463783 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.463755 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:52.469905 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.469884 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:52.499762 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.499731 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:52.500114 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.500102 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" Jun 11 19:38:52.500169 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.500117 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" Jun 11 19:38:52.500207 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.500194 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9298cba-ab81-4434-8442-fd1065988576" containerName="keycloak" Jun 11 19:38:52.504592 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.504556 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.506610 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.506585 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 19:38:52.506902 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.506727 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 19:38:52.506902 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.506803 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 19:38:52.506902 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.506882 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 19:38:52.507067 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.506889 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qv8cl\"" Jun 11 19:38:52.512915 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.512898 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:52.536715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.536686 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49vqs\" (UniqueName: \"kubernetes.io/projected/e016964c-7cb6-4a86-a017-e60f6402bd10-kube-api-access-49vqs\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.536844 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.536729 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e016964c-7cb6-4a86-a017-e60f6402bd10-test-realms\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.637768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.637689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49vqs\" (UniqueName: \"kubernetes.io/projected/e016964c-7cb6-4a86-a017-e60f6402bd10-kube-api-access-49vqs\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.637768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.637730 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e016964c-7cb6-4a86-a017-e60f6402bd10-test-realms\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.638436 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.638417 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e016964c-7cb6-4a86-a017-e60f6402bd10-test-realms\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.645674 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.645656 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49vqs\" (UniqueName: \"kubernetes.io/projected/e016964c-7cb6-4a86-a017-e60f6402bd10-kube-api-access-49vqs\") pod \"maas-keycloak-0\" (UID: \"e016964c-7cb6-4a86-a017-e60f6402bd10\") " pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.815231 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.815193 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:52.945795 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.945653 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 19:38:52.948648 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:38:52.948623 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode016964c_7cb6_4a86_a017_e60f6402bd10.slice/crio-c0f010ec79b222c36b19752ebfb8c7c23a0a3c2c09ec9bf192688a3139d1fcaa WatchSource:0}: Error finding container c0f010ec79b222c36b19752ebfb8c7c23a0a3c2c09ec9bf192688a3139d1fcaa: Status 404 returned error can't find the container with id c0f010ec79b222c36b19752ebfb8c7c23a0a3c2c09ec9bf192688a3139d1fcaa Jun 11 19:38:52.949945 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:52.949925 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:38:53.111028 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.110998 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9298cba-ab81-4434-8442-fd1065988576" path="/var/lib/kubelet/pods/d9298cba-ab81-4434-8442-fd1065988576/volumes" Jun 11 19:38:53.449974 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.449933 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e016964c-7cb6-4a86-a017-e60f6402bd10","Type":"ContainerStarted","Data":"ebc53776d3dbe5b1b9a1a06836262bccfbba61eb1298b1f812836cbb8f7bd664"} Jun 11 19:38:53.450438 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.450007 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e016964c-7cb6-4a86-a017-e60f6402bd10","Type":"ContainerStarted","Data":"c0f010ec79b222c36b19752ebfb8c7c23a0a3c2c09ec9bf192688a3139d1fcaa"} Jun 11 19:38:53.469510 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.469461 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.165774847 podStartE2EDuration="1.469445006s" totalImagesPullingTime="303.670159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:38:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:38:53.466807189 +0000 UTC m=+966.800860432" watchObservedRunningTime="2026-06-11 19:38:53.469445006 +0000 UTC m=+966.803498251" Jun 11 19:38:53.816437 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.816395 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 19:38:53.818077 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:53.818043 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:54.815812 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:54.815758 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:55.816643 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:55.816601 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:56.816650 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:56.816593 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:57.816106 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:57.816070 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:58.816599 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:58.816530 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:38:59.816314 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:38:59.816256 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:00.815954 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:00.815906 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:01.816581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:01.816540 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:02.815921 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:02.815873 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:39:02.816328 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:02.816293 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:03.816243 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:03.816130 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:04.816617 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:04.816560 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:05.816746 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:05.816693 2577 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.38:9000/health/started\": dial tcp 10.133.0.38:9000: connect: connection refused" Jun 11 19:39:06.938997 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:06.938946 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 19:39:06.958655 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:06.958601 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e016964c-7cb6-4a86-a017-e60f6402bd10" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:39:16.946130 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:16.946091 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 19:39:38.022776 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.022741 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk"] Jun 11 19:39:38.026466 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.026446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.028600 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.028574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 19:39:38.028715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.028607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 19:39:38.028875 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.028860 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 19:39:38.028875 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.028868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-czz8t\"" Jun 11 19:39:38.038319 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.038299 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk"] Jun 11 19:39:38.064884 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.064854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.064884 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.064884 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.065112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.065008 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138db3d3-aa30-4c34-883c-ce50a43f302d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.065112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.065045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d8wm\" (UniqueName: \"kubernetes.io/projected/138db3d3-aa30-4c34-883c-ce50a43f302d-kube-api-access-8d8wm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.065112 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.065072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.065229 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.065127 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166185 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166148 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138db3d3-aa30-4c34-883c-ce50a43f302d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166185 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d8wm\" (UniqueName: \"kubernetes.io/projected/138db3d3-aa30-4c34-883c-ce50a43f302d-kube-api-access-8d8wm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166501 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166501 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166245 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166501 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166298 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166501 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166705 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166839 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166808 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.166961 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.166853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.168792 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.168764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/138db3d3-aa30-4c34-883c-ce50a43f302d-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.168996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.168979 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138db3d3-aa30-4c34-883c-ce50a43f302d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.173930 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.173911 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d8wm\" (UniqueName: \"kubernetes.io/projected/138db3d3-aa30-4c34-883c-ce50a43f302d-kube-api-access-8d8wm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk\" (UID: \"138db3d3-aa30-4c34-883c-ce50a43f302d\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.336647 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.336554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:39:38.406477 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.406444 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:39:38.478556 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.478533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk"] Jun 11 19:39:38.480917 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:39:38.480889 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138db3d3_aa30_4c34_883c_ce50a43f302d.slice/crio-c99a63d6f6270f6a2d589cd75c5e31c52e4064e08b1d29aedabd1e3492c148f4 WatchSource:0}: Error finding container c99a63d6f6270f6a2d589cd75c5e31c52e4064e08b1d29aedabd1e3492c148f4: Status 404 returned error can't find the container with id c99a63d6f6270f6a2d589cd75c5e31c52e4064e08b1d29aedabd1e3492c148f4 Jun 11 19:39:38.716656 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:38.716562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" event={"ID":"138db3d3-aa30-4c34-883c-ce50a43f302d","Type":"ContainerStarted","Data":"c99a63d6f6270f6a2d589cd75c5e31c52e4064e08b1d29aedabd1e3492c148f4"} Jun 11 19:39:42.740676 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:42.740630 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" event={"ID":"138db3d3-aa30-4c34-883c-ce50a43f302d","Type":"ContainerStarted","Data":"630abe638e9e8115c9fa6e02cb3bfb0bec6ad0405d3727e051303ef2eca2c134"} Jun 11 19:39:46.823161 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:39:46.823125 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:40:03.888734 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:03.888695 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:40:08.986798 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:08.986755 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9"] Jun 11 19:40:08.990668 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:08.990644 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:08.992666 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:08.992646 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 19:40:09.001330 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.001306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9"] Jun 11 19:40:09.044178 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044135 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.044396 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044192 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.044396 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044238 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.044396 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044314 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf44l\" (UniqueName: \"kubernetes.io/projected/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kube-api-access-tf44l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.044396 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044344 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.044568 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.044438 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145016 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145060 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145054 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145105 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf44l\" (UniqueName: \"kubernetes.io/projected/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kube-api-access-tf44l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145128 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145158 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145311 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145213 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145476 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145626 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.145665 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.145623 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.147553 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.147531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.147898 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.147883 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.153274 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.153252 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf44l\" (UniqueName: \"kubernetes.io/projected/79a483e2-6e53-4aa1-aa25-9e1cc1225eeb-kube-api-access-tf44l\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9\" (UID: \"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.301411 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.301379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:40:09.440459 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.440431 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9"] Jun 11 19:40:09.442260 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:40:09.442233 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a483e2_6e53_4aa1_aa25_9e1cc1225eeb.slice/crio-0af7edafa7b884faa56b2d35b27ad9f2bd3a0e321d1a6a054cc2f6726fc25831 WatchSource:0}: Error finding container 0af7edafa7b884faa56b2d35b27ad9f2bd3a0e321d1a6a054cc2f6726fc25831: Status 404 returned error can't find the container with id 0af7edafa7b884faa56b2d35b27ad9f2bd3a0e321d1a6a054cc2f6726fc25831 Jun 11 19:40:09.876522 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.876475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" event={"ID":"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb","Type":"ContainerStarted","Data":"1231e79125ae74175ee235ca5e27d5d6d93cd7ad9b7654d9bdea8fa219ee2e35"} Jun 11 19:40:09.876704 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.876603 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" event={"ID":"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb","Type":"ContainerStarted","Data":"0af7edafa7b884faa56b2d35b27ad9f2bd3a0e321d1a6a054cc2f6726fc25831"} Jun 11 19:40:09.938675 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:09.938636 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:40:13.189254 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.189216 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h"] Jun 11 19:40:13.195183 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.195150 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.197217 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.197192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 19:40:13.203454 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.203422 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h"] Jun 11 19:40:13.282139 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282101 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.282332 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282158 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tw82\" (UniqueName: \"kubernetes.io/projected/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kube-api-access-5tw82\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.282332 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282267 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.282332 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.282498 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282423 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.282498 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.282472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383608 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383623 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tw82\" (UniqueName: \"kubernetes.io/projected/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kube-api-access-5tw82\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383711 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.383781 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.383755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.384058 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.384034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.384119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.384080 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.384119 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.384106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.386128 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.386106 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.386388 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.386338 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.392434 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.392408 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tw82\" (UniqueName: \"kubernetes.io/projected/f7c6be81-ea60-4d9f-b43f-1ba82ccab058-kube-api-access-5tw82\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h\" (UID: \"f7c6be81-ea60-4d9f-b43f-1ba82ccab058\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.508329 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.508229 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:40:13.646763 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.646739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h"] Jun 11 19:40:13.649702 ip-10-0-139-23 kubenswrapper[2577]: W0611 19:40:13.649659 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7c6be81_ea60_4d9f_b43f_1ba82ccab058.slice/crio-336059d8385d20038145ecb96c73983be404dc91a9c73ff42dfa2c4a2e84c6a9 WatchSource:0}: Error finding container 336059d8385d20038145ecb96c73983be404dc91a9c73ff42dfa2c4a2e84c6a9: Status 404 returned error can't find the container with id 336059d8385d20038145ecb96c73983be404dc91a9c73ff42dfa2c4a2e84c6a9 Jun 11 19:40:13.898000 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.897963 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" event={"ID":"f7c6be81-ea60-4d9f-b43f-1ba82ccab058","Type":"ContainerStarted","Data":"5e75f97046b1a81ffdea2490ed05d2309519664ce02cdaf60d4b750f6e68d368"} Jun 11 19:40:13.898189 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:13.898029 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" event={"ID":"f7c6be81-ea60-4d9f-b43f-1ba82ccab058","Type":"ContainerStarted","Data":"336059d8385d20038145ecb96c73983be404dc91a9c73ff42dfa2c4a2e84c6a9"} Jun 11 19:40:14.195121 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:14.195026 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:40:31.492321 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:40:31.492285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:41:03.139908 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:03.139868 2577 generic.go:356] "Generic (PLEG): container finished" podID="79a483e2-6e53-4aa1-aa25-9e1cc1225eeb" containerID="1231e79125ae74175ee235ca5e27d5d6d93cd7ad9b7654d9bdea8fa219ee2e35" exitCode=0 Jun 11 19:41:03.140327 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:03.139939 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" event={"ID":"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb","Type":"ContainerDied","Data":"1231e79125ae74175ee235ca5e27d5d6d93cd7ad9b7654d9bdea8fa219ee2e35"} Jun 11 19:41:05.150791 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:05.150759 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" event={"ID":"79a483e2-6e53-4aa1-aa25-9e1cc1225eeb","Type":"ContainerStarted","Data":"5982446209be41e9332e084aeed9aa30d4ff0be5b4420f808ad567b14e41fccd"} Jun 11 19:41:05.168050 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:05.167992 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" podStartSLOduration=2.954293193 podStartE2EDuration="57.167974282s" totalImagesPullingTime="1.041662681s" totalInitContainerRuntime="53.172018408s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:40:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:41:05.167775187 +0000 UTC m=+1098.501828451" watchObservedRunningTime="2026-06-11 19:41:05.167974282 +0000 UTC m=+1098.502027518" Jun 11 19:41:06.156894 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:06.156860 2577 generic.go:356] "Generic (PLEG): container finished" podID="f7c6be81-ea60-4d9f-b43f-1ba82ccab058" containerID="5e75f97046b1a81ffdea2490ed05d2309519664ce02cdaf60d4b750f6e68d368" exitCode=0 Jun 11 19:41:06.157286 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:06.156936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" event={"ID":"f7c6be81-ea60-4d9f-b43f-1ba82ccab058","Type":"ContainerDied","Data":"5e75f97046b1a81ffdea2490ed05d2309519664ce02cdaf60d4b750f6e68d368"} Jun 11 19:41:07.164368 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:07.164328 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" event={"ID":"f7c6be81-ea60-4d9f-b43f-1ba82ccab058","Type":"ContainerStarted","Data":"afbf9f8bf3fb1adffd78a52f281c16a4caf45d0b0e5ad50856dd90fa010428e9"} Jun 11 19:41:07.186911 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:07.186853 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" podStartSLOduration=2.004287601 podStartE2EDuration="54.186836672s" totalImagesPullingTime="218.689489ms" totalInitContainerRuntime="51.963859582s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:41:07.183835729 +0000 UTC m=+1100.517888971" watchObservedRunningTime="2026-06-11 19:41:07.186836672 +0000 UTC m=+1100.520889917" Jun 11 19:41:09.301951 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:09.301922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:41:09.302557 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:09.302005 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:41:09.315867 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:09.315839 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:41:10.190285 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:10.190251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9" Jun 11 19:41:13.508718 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:13.508683 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:41:13.509161 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:13.508735 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:41:13.521389 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:13.521365 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:41:14.209400 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:14.209339 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h" Jun 11 19:41:28.278779 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:28.278747 2577 generic.go:356] "Generic (PLEG): container finished" podID="138db3d3-aa30-4c34-883c-ce50a43f302d" containerID="630abe638e9e8115c9fa6e02cb3bfb0bec6ad0405d3727e051303ef2eca2c134" exitCode=0 Jun 11 19:41:28.279159 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:28.278832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" event={"ID":"138db3d3-aa30-4c34-883c-ce50a43f302d","Type":"ContainerDied","Data":"630abe638e9e8115c9fa6e02cb3bfb0bec6ad0405d3727e051303ef2eca2c134"} Jun 11 19:41:29.285105 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:29.285074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" event={"ID":"138db3d3-aa30-4c34-883c-ce50a43f302d","Type":"ContainerStarted","Data":"1b47996f71b97677c76bf37f835a7ae4052cc4966e90100d4159274bbe21ba7c"} Jun 11 19:41:29.304237 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:29.304187 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" podStartSLOduration=1.677115008 podStartE2EDuration="1m51.304170661s" totalImagesPullingTime="4.256720337s" totalInitContainerRuntime="1m45.370335316s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:41:29.30197117 +0000 UTC m=+1122.636024431" watchObservedRunningTime="2026-06-11 19:41:29.304170661 +0000 UTC m=+1122.638223906" Jun 11 19:41:38.336875 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:38.336841 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:41:38.337309 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:38.336926 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:41:38.349265 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:38.349244 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:41:39.344208 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:41:39.344171 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk" Jun 11 19:42:23.085779 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:23.085699 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:42:31.883816 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:31.883777 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:42:42.388021 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:42.387989 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:42:47.170485 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:47.170457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:42:47.174320 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:47.174300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:42:51.979627 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:42:51.979596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:43:01.584755 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:43:01.584721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:43:10.985528 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:43:10.985497 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:44:23.393001 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:44:23.392968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:44:39.292380 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:44:39.292330 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:45:17.193190 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:45:17.193108 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:45:33.895854 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:45:33.895816 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:45:48.384493 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:45:48.384456 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:46:05.019057 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:46:05.019022 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:47:04.691597 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:04.691557 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:47:13.583080 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:13.583046 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:47:30.485560 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:30.485527 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:47:38.885064 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:38.885025 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:47:47.209413 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:47.209386 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:47:47.216448 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:47.216427 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:47:56.288326 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:47:56.288289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:48:05.089054 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:48:05.088967 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:48:37.283635 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:48:37.283598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:48:45.781420 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:48:45.781388 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:48:54.491312 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:48:54.491277 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:02.285537 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:02.285502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:10.699463 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:10.699418 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:19.483747 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:19.483707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:23.288402 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:23.288341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:36.085996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:36.085914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:49:48.081044 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:49:48.081008 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:50:15.881427 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:50:15.881384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:50:18.383176 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:50:18.383133 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:50:35.985625 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:50:35.985595 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:50:42.784188 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:50:42.784155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:01.790440 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:01.790397 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:06.182766 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:06.182684 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:10.182896 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:10.182863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:20.485949 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:20.485909 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:27.785974 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:27.785930 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:37.883908 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:37.883864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:45.585849 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:45.585816 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:51:55.585737 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:51:55.585702 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:52:02.191029 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:52:02.190989 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:52:11.189887 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:52:11.189852 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:52:19.283581 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:52:19.283545 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:52:47.243597 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:52:47.243571 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:52:47.251047 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:52:47.251027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:54:48.987099 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:54:48.987058 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:54:53.480072 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:54:53.480036 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:55:18.582136 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:55:18.582099 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:55:23.492302 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:55:23.492264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:55:30.492120 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:55:30.492084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:55:41.283578 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:55:41.283506 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:55:49.684768 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:55:49.684738 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:00.585104 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:00.585063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:09.188621 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:09.188590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:19.083414 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:19.083381 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:28.582872 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:28.582839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:39.380847 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:39.380808 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:56:48.111996 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:56:48.111958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:57:47.278133 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:57:47.278101 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:57:47.286146 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:57:47.286126 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 19:58:21.780175 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:58:21.780141 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:04.790904 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:04.790819 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:12.479715 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:12.479678 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:21.982507 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:21.982475 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:30.000775 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:30.000728 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:38.991838 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:38.991804 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:51.678855 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:51.678810 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 19:59:59.986775 ip-10-0-139-23 kubenswrapper[2577]: I0611 19:59:59.986742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:04.786921 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:04.786835 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:08.295011 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:08.294975 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:14.986794 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:14.986756 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:23.791421 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:23.791391 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:31.485894 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:31.485853 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:41.887036 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:41.886998 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:00:59.792048 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:00:59.792010 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:08.191210 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:08.191170 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:17.085907 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:17.085867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:25.481544 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:25.481511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:42.493875 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:42.493792 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:50.892162 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:50.892128 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:01:59.587847 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:01:59.587815 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:07.579376 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:07.579309 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:17.181315 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:17.181288 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:25.384832 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:25.384795 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:34.393603 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:34.393572 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:45.252075 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:45.252032 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:02:47.315552 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:47.315524 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 20:02:47.322976 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:47.322955 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m5c28_2233ae1d-6633-4e90-862b-cba09e833213/ovn-acl-logging/0.log" Jun 11 20:02:54.512949 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:02:54.512913 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:05.298972 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:05.298874 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:14.683708 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:14.683675 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:19.688105 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:19.688071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:26.981791 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:26.981754 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:31.986331 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:31.986295 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mm4z9"] Jun 11 20:03:43.315235 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:43.315200 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-5zrcv_75e5b3f8-42cf-49a7-b481-3cf7b3b080da/copy-manifests/0.log" Jun 11 20:03:43.321748 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:43.321726 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-5zrcv_75e5b3f8-42cf-49a7-b481-3cf7b3b080da/manager/0.log" Jun 11 20:03:45.157340 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:45.157313 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs2c2_1248f821-a91b-4cee-9b94-00edc221d987/kuadrant-console-plugin/0.log" Jun 11 20:03:45.491502 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:45.491399 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mm4z9_59e14ced-ee21-4135-821e-994a52334196/limitador/0.log" Jun 11 20:03:46.154603 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:46.154570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b6fb5bf5-lmtcw_a71bafe8-5f3f-4e8e-91fe-8c4b71491feb/kube-auth-proxy/0.log" Jun 11 20:03:47.015820 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.015789 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk_138db3d3-aa30-4c34-883c-ce50a43f302d/storage-initializer/0.log" Jun 11 20:03:47.023020 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.022998 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-whdnk_138db3d3-aa30-4c34-883c-ce50a43f302d/main/0.log" Jun 11 20:03:47.349687 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.349570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9_79a483e2-6e53-4aa1-aa25-9e1cc1225eeb/storage-initializer/0.log" Jun 11 20:03:47.356761 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.356733 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cdgcq9_79a483e2-6e53-4aa1-aa25-9e1cc1225eeb/main/0.log" Jun 11 20:03:47.466206 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.466162 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h_f7c6be81-ea60-4d9f-b43f-1ba82ccab058/storage-initializer/0.log" Jun 11 20:03:47.473107 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:47.473081 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-gpl7h_f7c6be81-ea60-4d9f-b43f-1ba82ccab058/main/0.log" Jun 11 20:03:54.013844 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:54.013811 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rr6dj_8d704bbe-2e69-4114-a0cd-b1dfdd7d8d5c/global-pull-secret-syncer/0.log" Jun 11 20:03:54.089718 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:54.089677 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5fp84_182f02c3-60ea-499c-889c-94f34fa2c5ae/konnectivity-agent/0.log" Jun 11 20:03:54.162182 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:03:54.162159 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-23.ec2.internal_46a3b7e0737b02e9df1ca865f64b4f49/haproxy/0.log" Jun 11 20:04:00.030727 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:00.030700 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-vs2c2_1248f821-a91b-4cee-9b94-00edc221d987/kuadrant-console-plugin/0.log" Jun 11 20:04:00.160638 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:00.160609 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mm4z9_59e14ced-ee21-4135-821e-994a52334196/limitador/0.log" Jun 11 20:04:01.583679 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.583648 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/alertmanager/0.log" Jun 11 20:04:01.605454 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.605424 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/config-reloader/0.log" Jun 11 20:04:01.625843 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.625818 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/kube-rbac-proxy-web/0.log" Jun 11 20:04:01.651092 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.651067 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/kube-rbac-proxy/0.log" Jun 11 20:04:01.671626 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.671584 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/kube-rbac-proxy-metric/0.log" Jun 11 20:04:01.694775 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.694748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/prom-label-proxy/0.log" Jun 11 20:04:01.716178 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.716111 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7e7dd384-0eec-4d79-87a1-c1b232432d87/init-config-reloader/0.log" Jun 11 20:04:01.755260 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.755234 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-kz4df_57a6dfd1-c61c-444e-b876-25be51e3e804/cluster-monitoring-operator/0.log" Jun 11 20:04:01.781444 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.781418 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-state-metrics/0.log" Jun 11 20:04:01.801210 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.801190 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-rbac-proxy-main/0.log" Jun 11 20:04:01.820518 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.820490 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-9qwns_c9d31315-da39-4f90-8072-c480b7dea728/kube-rbac-proxy-self/0.log" Jun 11 20:04:01.845149 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.845128 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85496bbb68-59r2r_f0523267-95c9-4f5d-b990-778585c90c01/metrics-server/0.log" Jun 11 20:04:01.982337 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:01.982254 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/node-exporter/0.log" Jun 11 20:04:02.002436 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.002412 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/kube-rbac-proxy/0.log" Jun 11 20:04:02.021759 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.021733 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gzc2g_2c206307-3ed6-4a88-91c2-913107d66caa/init-textfile/0.log" Jun 11 20:04:02.132282 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.132250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/kube-rbac-proxy-main/0.log" Jun 11 20:04:02.155771 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.155737 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/kube-rbac-proxy-self/0.log" Jun 11 20:04:02.183672 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.183647 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-pd6hd_c25ff998-49b8-4db0-b87c-dfd4e83778af/openshift-state-metrics/0.log" Jun 11 20:04:02.226136 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.226108 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/prometheus/0.log" Jun 11 20:04:02.250569 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.250493 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/config-reloader/0.log" Jun 11 20:04:02.272524 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.272491 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/thanos-sidecar/0.log" Jun 11 20:04:02.297575 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.297541 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/kube-rbac-proxy-web/0.log" Jun 11 20:04:02.315480 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.315457 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/kube-rbac-proxy/0.log" Jun 11 20:04:02.337294 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.337267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/kube-rbac-proxy-thanos/0.log" Jun 11 20:04:02.360899 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.360878 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2c05a6a1-53dc-4234-9189-dd6f12dfe243/init-config-reloader/0.log" Jun 11 20:04:02.428754 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.428723 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-g7jr5_4de89c15-e677-4ace-837b-64575e555490/prometheus-operator-admission-webhook/0.log" Jun 11 20:04:02.534038 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.534012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/thanos-query/0.log" Jun 11 20:04:02.553830 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.553807 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-web/0.log" Jun 11 20:04:02.574476 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.574437 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy/0.log" Jun 11 20:04:02.599173 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.599151 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/prom-label-proxy/0.log" Jun 11 20:04:02.618345 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.618314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-rules/0.log" Jun 11 20:04:02.637807 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:02.637782 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-84c958778-gdd77_1ca28822-e26f-4acc-aafd-b8626b1e3c63/kube-rbac-proxy-metrics/0.log" Jun 11 20:04:03.886113 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:03.886084 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-98kqh_80ca7aeb-074a-4765-9bc6-5d815ed4f0c5/networking-console-plugin/0.log" Jun 11 20:04:05.121495 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.121466 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cd85ccb67-xbgnv_d9d946d3-c398-444a-b568-bd972734889f/console/0.log" Jun 11 20:04:05.155428 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.155405 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-ksrsg_7cae750e-2ba3-418e-92b0-6dda68e176ab/download-server/0.log" Jun 11 20:04:05.350594 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.350563 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h"] Jun 11 20:04:05.354488 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.354470 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.356824 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.356798 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtt8t\"/\"openshift-service-ca.crt\"" Jun 11 20:04:05.356824 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.356814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vtt8t\"/\"default-dockercfg-twl68\"" Jun 11 20:04:05.356968 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.356836 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtt8t\"/\"kube-root-ca.crt\"" Jun 11 20:04:05.360712 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.360694 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h"] Jun 11 20:04:05.460986 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.460904 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-lib-modules\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.460986 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.460946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-proc\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.460986 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.460963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-podres\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.460986 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.460979 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tt7c\" (UniqueName: \"kubernetes.io/projected/9fd11e75-10f2-4150-8939-e93125c4e07a-kube-api-access-4tt7c\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.461241 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.461099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-sys\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562223 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562187 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-lib-modules\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562235 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-proc\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-podres\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562284 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tt7c\" (UniqueName: \"kubernetes.io/projected/9fd11e75-10f2-4150-8939-e93125c4e07a-kube-api-access-4tt7c\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562319 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-proc\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-sys\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562415 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562384 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-lib-modules\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562691 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-sys\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.562691 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.562451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fd11e75-10f2-4150-8939-e93125c4e07a-podres\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.572663 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.572645 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tt7c\" (UniqueName: \"kubernetes.io/projected/9fd11e75-10f2-4150-8939-e93125c4e07a-kube-api-access-4tt7c\") pod \"perf-node-gather-daemonset-2j72h\" (UID: \"9fd11e75-10f2-4150-8939-e93125c4e07a\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.665797 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.665763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:05.798458 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.798432 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h"] Jun 11 20:04:05.800635 ip-10-0-139-23 kubenswrapper[2577]: W0611 20:04:05.800607 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fd11e75_10f2_4150_8939_e93125c4e07a.slice/crio-4ca8f8d01eb1eea0f8436fd688cb1698eda054ac1a07ab2ab28b27814d1a4108 WatchSource:0}: Error finding container 4ca8f8d01eb1eea0f8436fd688cb1698eda054ac1a07ab2ab28b27814d1a4108: Status 404 returned error can't find the container with id 4ca8f8d01eb1eea0f8436fd688cb1698eda054ac1a07ab2ab28b27814d1a4108 Jun 11 20:04:05.981586 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:05.981493 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-2h6bx_a6da7dea-1b4e-4ede-bc18-9307b73bd294/volume-data-source-validator/0.log" Jun 11 20:04:06.058801 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:06.058771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" event={"ID":"9fd11e75-10f2-4150-8939-e93125c4e07a","Type":"ContainerStarted","Data":"3569857fe6f4d971cab5ca9448312c9e3dbd7873b1b902cd3dc85e6db405f337"} Jun 11 20:04:06.058967 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:06.058826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" event={"ID":"9fd11e75-10f2-4150-8939-e93125c4e07a","Type":"ContainerStarted","Data":"4ca8f8d01eb1eea0f8436fd688cb1698eda054ac1a07ab2ab28b27814d1a4108"} Jun 11 20:04:06.058967 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:06.058950 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:06.081285 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:06.081242 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" podStartSLOduration=1.08122717 podStartE2EDuration="1.08122717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:06.07870286 +0000 UTC m=+2479.412756104" watchObservedRunningTime="2026-06-11 20:04:06.08122717 +0000 UTC m=+2479.415280464" Jun 11 20:04:07.263892 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:07.263862 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vm8f_fd844499-29b8-4186-8b70-32dacb2985ac/dns/0.log" Jun 11 20:04:07.284343 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:07.284323 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8vm8f_fd844499-29b8-4186-8b70-32dacb2985ac/kube-rbac-proxy/0.log" Jun 11 20:04:07.396801 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:07.396767 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wbwgw_56935d44-34a2-4aed-8347-715d6b172d19/dns-node-resolver/0.log" Jun 11 20:04:08.025727 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:08.025685 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wnjm5_187bd590-1842-4700-81bf-0fb8ddc5c883/node-ca/0.log" Jun 11 20:04:09.033453 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:09.033425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b6fb5bf5-lmtcw_a71bafe8-5f3f-4e8e-91fe-8c4b71491feb/kube-auth-proxy/0.log" Jun 11 20:04:09.948249 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:09.948226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njqmp_662ec37c-a7eb-4d29-ad0a-6750e33c2cbb/serve-healthcheck-canary/0.log" Jun 11 20:04:10.682637 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:10.682610 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf4kc_2759a527-0e5d-4494-b760-a6b0facff5fe/kube-rbac-proxy/0.log" Jun 11 20:04:10.716249 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:10.716224 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf4kc_2759a527-0e5d-4494-b760-a6b0facff5fe/exporter/0.log" Jun 11 20:04:10.752327 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:10.752302 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gf4kc_2759a527-0e5d-4494-b760-a6b0facff5fe/extractor/0.log" Jun 11 20:04:12.074731 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:12.074706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-2j72h" Jun 11 20:04:13.644325 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:13.644294 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-5zrcv_75e5b3f8-42cf-49a7-b481-3cf7b3b080da/manager/0.log" Jun 11 20:04:13.668426 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:13.668395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-5zrcv_75e5b3f8-42cf-49a7-b481-3cf7b3b080da/copy-manifests/0.log" Jun 11 20:04:15.483264 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:15.483236 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b7c45796d-4t42q_6c20541e-2285-43c0-992b-394a983ba4b0/manager/0.log" Jun 11 20:04:19.073920 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:19.073886 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b6fb5bf5-lmtcw_a71bafe8-5f3f-4e8e-91fe-8c4b71491feb/kube-auth-proxy/0.log" Jun 11 20:04:20.472536 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:20.472502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b6fb5bf5-lmtcw_a71bafe8-5f3f-4e8e-91fe-8c4b71491feb/kube-auth-proxy/0.log" Jun 11 20:04:22.612682 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:22.612652 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b6fb5bf5-lmtcw_a71bafe8-5f3f-4e8e-91fe-8c4b71491feb/kube-auth-proxy/0.log" Jun 11 20:04:22.850358 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:22.850314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7mq5z_ab031cdc-f7d9-42b7-b630-5ef02a2127e1/kube-multus/0.log" Jun 11 20:04:23.214911 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.214837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/kube-multus-additional-cni-plugins/0.log" Jun 11 20:04:23.239973 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.239953 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/egress-router-binary-copy/0.log" Jun 11 20:04:23.262509 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.262489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/cni-plugins/0.log" Jun 11 20:04:23.285228 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.285214 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/bond-cni-plugin/0.log" Jun 11 20:04:23.311035 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.311019 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/routeoverride-cni/0.log" Jun 11 20:04:23.330863 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.330843 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/whereabouts-cni-bincopy/0.log" Jun 11 20:04:23.351480 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.351461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r5jv9_443d763d-e6c5-40b5-b19a-1fa43077e5a1/whereabouts-cni/0.log" Jun 11 20:04:23.445556 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.445532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ngc75_8ba4f746-0a84-4e98-bed3-b203699f51a4/network-metrics-daemon/0.log" Jun 11 20:04:23.465868 ip-10-0-139-23 kubenswrapper[2577]: I0611 20:04:23.465820 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ngc75_8ba4f746-0a84-4e98-bed3-b203699f51a4/kube-rbac-proxy/0.log"