Jun 02 01:08:07.569479 ip-10-0-139-243 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:08:07.569493 ip-10-0-139-243 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:08:07.569503 ip-10-0-139-243 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:08:07.569823 ip-10-0-139-243 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:08:17.732609 ip-10-0-139-243 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 01:08:17.732624 ip-10-0-139-243 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3b82ee8f3b9a4b45b38ca63c004503f2 -- Jun 02 01:10:36.164221 ip-10-0-139-243 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:10:36.625081 ip-10-0-139-243 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:36.625081 ip-10-0-139-243 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:10:36.625081 ip-10-0-139-243 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:36.625081 ip-10-0-139-243 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:10:36.625081 ip-10-0-139-243 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:10:36.626149 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.626067 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:10:36.630341 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630325 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630342 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630346 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630349 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630352 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630355 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630358 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630361 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630363 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630366 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630368 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630371 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630373 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630376 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630378 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630381 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630384 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630387 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:36.630380 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630390 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630394 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630398 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630401 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630409 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630412 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630414 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630417 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630420 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630423 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630428 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630432 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630435 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630437 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630440 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630442 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630445 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630447 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:36.630809 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630450 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630452 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630455 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630457 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630460 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630463 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630465 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630468 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630470 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630473 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630475 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630478 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630481 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630483 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630486 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630488 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630492 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630494 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630497 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630499 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:36.631279 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630502 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630504 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630507 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630509 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630518 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630522 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630525 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630527 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630530 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630533 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630535 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630539 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630542 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630544 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630547 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630549 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630552 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630555 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630558 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630561 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:36.631765 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630563 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630566 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630569 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630571 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630574 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630576 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630579 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630581 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630584 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630587 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.630998 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631003 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631007 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631010 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631013 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631015 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631018 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631020 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631023 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631027 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:36.632259 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631030 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631032 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631035 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631038 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631040 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631043 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631045 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631048 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631052 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631054 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631057 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631060 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631063 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631065 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631068 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631070 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631073 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631075 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631077 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631080 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:36.632737 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631083 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631086 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631088 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631091 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631093 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631096 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631099 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631102 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631104 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631107 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631109 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631112 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631114 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631117 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631119 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631122 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631124 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631126 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631128 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:36.633335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631133 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631136 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631139 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631142 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631145 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631149 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631151 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631155 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631157 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631160 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631162 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631166 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631168 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631171 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631173 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631176 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631179 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631181 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631184 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631186 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:36.633796 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631189 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631191 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631194 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631196 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631199 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631201 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631204 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631206 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631209 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631211 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631214 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631216 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631219 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631221 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631224 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631226 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631229 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631294 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631301 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631307 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631312 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:10:36.634330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631316 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631320 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631324 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631329 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631333 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631336 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631339 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631343 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631346 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631349 2574 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631352 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631355 2574 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631357 2574 flags.go:64] FLAG: --cloud-config="" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631360 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631363 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631367 2574 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631370 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631373 2574 flags.go:64] FLAG: --config-dir="" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631375 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631379 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631382 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631386 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631389 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631392 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:10:36.634843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631395 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631398 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631401 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631404 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631407 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631411 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631415 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631418 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631420 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631423 2574 flags.go:64] FLAG: --enable-server="true" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631426 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631434 2574 flags.go:64] FLAG: --event-burst="100" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631437 2574 flags.go:64] FLAG: --event-qps="50" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631440 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631443 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631446 2574 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631450 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631453 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631456 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631459 2574 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631462 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631465 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631468 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631471 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631474 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:10:36.635440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631477 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631480 2574 flags.go:64] FLAG: --feature-gates="" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631483 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631486 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631489 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631492 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631495 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631498 2574 flags.go:64] FLAG: --help="false" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631501 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631505 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631507 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631510 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631513 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631517 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631520 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631523 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631526 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631529 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631531 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631535 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631537 2574 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631540 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631543 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:10:36.636110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631546 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631551 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631554 2574 flags.go:64] FLAG: --lock-file="" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631557 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631560 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631563 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631567 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631570 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631573 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631576 2574 flags.go:64] FLAG: --logging-format="text" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631579 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631582 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631585 2574 flags.go:64] FLAG: --manifest-url="" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631588 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631592 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631595 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631599 2574 flags.go:64] FLAG: --max-pods="110" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631602 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631605 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631608 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631611 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631614 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631617 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631620 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631627 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:10:36.636665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631630 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631634 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631637 2574 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631640 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631645 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631648 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631651 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631654 2574 flags.go:64] FLAG: --port="10250" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631658 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631662 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c7783526158bb746" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631665 2574 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631668 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631671 2574 flags.go:64] FLAG: --register-node="true" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631674 2574 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631677 2574 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631680 2574 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631683 2574 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631686 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631689 2574 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631693 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631696 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631699 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631701 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631704 2574 flags.go:64] FLAG: --runonce="false" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631707 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:10:36.637317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631711 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631714 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631717 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631720 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631723 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631726 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631729 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631733 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631736 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631739 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631741 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631744 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631747 2574 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631750 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631755 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631759 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631762 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631766 2574 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631770 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631773 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631775 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631778 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631782 2574 flags.go:64] FLAG: --v="2" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631786 2574 flags.go:64] FLAG: --version="false" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631790 2574 flags.go:64] FLAG: --vmodule="" Jun 02 01:10:36.637954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631794 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.631798 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631883 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631887 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631890 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631893 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631895 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631898 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631901 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631904 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631906 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631909 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631912 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631914 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631917 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631920 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631923 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631925 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631928 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631931 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:36.638576 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631934 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631936 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631940 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631943 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631945 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631948 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631951 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631955 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631958 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631976 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631979 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631982 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631985 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631988 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631991 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631994 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.631997 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632000 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632003 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632008 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:36.639074 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632011 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632014 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632017 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632020 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632023 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632025 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632028 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632030 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632033 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632036 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632039 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632041 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632044 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632046 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632052 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632056 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632059 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632062 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632064 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:36.639583 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632067 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632070 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632072 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632075 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632078 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632081 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632083 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632086 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632089 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632091 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632094 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632096 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632100 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632103 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632106 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632108 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632111 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632113 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632116 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632118 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:36.640067 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632121 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632124 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632126 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632129 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632132 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632134 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632136 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632140 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.632142 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.632862 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.639027 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.639042 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639088 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639093 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639097 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639100 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:36.640544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639103 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639105 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639108 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639111 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639113 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639116 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639119 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639123 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639128 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639131 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639134 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639136 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639140 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639142 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639146 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639149 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639152 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639156 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639160 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:36.640947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639163 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639166 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639168 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639171 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639174 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639176 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639179 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639182 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639187 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639190 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639193 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639196 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639198 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639201 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639204 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639206 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639209 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639212 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639214 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639217 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:36.641421 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639220 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639222 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639225 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639227 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639230 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639232 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639235 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639237 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639240 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639242 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639245 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639248 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639250 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639253 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639255 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639257 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639260 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639262 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639265 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639268 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:36.641910 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639271 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639274 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639277 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639280 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639282 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639285 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639288 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639290 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639292 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639295 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639298 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639300 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639303 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639305 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639307 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639310 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639312 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639315 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639317 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639320 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:36.642423 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639322 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639325 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639327 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.639333 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639431 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639436 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639439 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639442 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639445 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639448 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639451 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639454 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639457 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639460 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639463 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:10:36.642909 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639466 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639470 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639473 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639475 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639478 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639481 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639483 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639486 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639489 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639491 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639494 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639497 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639499 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639501 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639504 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639506 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639509 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639512 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639514 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639517 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:10:36.643293 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639519 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639522 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639525 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639527 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639530 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639532 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639535 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639538 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639540 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639544 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639546 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639549 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639552 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639555 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639558 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639560 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639563 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639566 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639568 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639571 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:10:36.643777 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639573 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639576 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639578 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639581 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639584 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639586 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639590 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639593 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639596 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639599 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639601 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639604 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639606 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639609 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639611 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639614 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639616 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639619 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639621 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:10:36.644329 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639625 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639627 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639630 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639632 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639636 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639639 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639643 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639645 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639648 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639651 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639654 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639657 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639659 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639662 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639664 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:10:36.644793 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:36.639667 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:10:36.645211 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.639671 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:10:36.645211 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.639765 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:10:36.645211 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.644763 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:10:36.645786 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.645775 2574 server.go:1019] "Starting client certificate rotation" Jun 02 01:10:36.646244 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.646226 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:36.646942 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.646930 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:10:36.671686 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.671669 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:36.673500 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.673469 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:10:36.685902 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.685884 2574 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:10:36.691654 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.691639 2574 log.go:25] "Validated CRI v1 image API" Jun 02 01:10:36.695001 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.694988 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:10:36.699036 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.699016 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9aa075a3-edd9-4b36-85ed-e85678148ad0:/dev/nvme0n1p3 ea18a6fa-e2b5-4c89-8bee-fc3358dabf9e:/dev/nvme0n1p4] Jun 02 01:10:36.699115 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.699036 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:10:36.703835 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.703816 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:36.703926 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.703309 2574 manager.go:217] Machine: {Timestamp:2026-06-02 01:10:36.702799403 +0000 UTC m=+0.409765733 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132918 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f399480c83d279a90a384507f78ed SystemUUID:ec2f3994-80c8-3d27-9a90-a384507f78ed BootID:3b82ee8f-3b9a-4b45-b38c-a63c004503f2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1c:8e:2f:8a:9b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1c:8e:2f:8a:9b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:50:77:e3:e1:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:10:36.704368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.704356 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:10:36.704476 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.704462 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:10:36.706223 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.706200 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:10:36.706353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.706227 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-243.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:10:36.706397 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.706359 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:10:36.706397 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.706368 2574 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:10:36.706397 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.706375 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:36.707285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.707275 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:10:36.708061 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.708051 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:36.708173 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.708164 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:10:36.710415 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.710406 2574 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:10:36.710447 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.710419 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:10:36.710447 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.710431 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:10:36.710447 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.710440 2574 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:10:36.710447 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.710447 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:10:36.711479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.711467 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:36.711518 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.711486 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:10:36.716731 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.716708 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:10:36.718472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.718459 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:10:36.720546 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720532 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:10:36.720591 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720555 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:10:36.720591 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720566 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:10:36.720591 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720575 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:10:36.720591 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720588 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720598 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720606 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720614 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720625 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720635 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720648 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:10:36.720693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.720658 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:10:36.721728 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.721715 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:10:36.721770 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.721730 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:10:36.725232 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.725108 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:10:36.725307 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.725303 2574 server.go:1295] "Started kubelet" Jun 02 01:10:36.725421 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.725368 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:10:36.725421 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.725399 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:10:36.725549 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.725436 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:10:36.725549 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.725489 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:10:36.725781 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.725394 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:10:36.726142 ip-10-0-139-243 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:10:36.727418 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.727406 2574 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:10:36.729096 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.729080 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:10:36.732978 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.732932 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:36.733287 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.733265 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:10:36.733552 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733537 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:10:36.733609 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733597 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:10:36.733649 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733612 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:10:36.733723 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733707 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:10:36.733779 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733752 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:10:36.733779 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.733760 2574 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:10:36.734294 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734278 2574 factory.go:55] Registering systemd factory Jun 02 01:10:36.734294 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734287 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-243.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:10:36.734294 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734297 2574 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:10:36.734449 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.734415 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:36.734698 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734566 2574 factory.go:153] Registering CRI-O factory Jun 02 01:10:36.734698 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734580 2574 factory.go:223] Registration of the crio container factory successfully Jun 02 01:10:36.734777 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734718 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:10:36.734777 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734738 2574 factory.go:103] Registering Raw factory Jun 02 01:10:36.734777 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.734758 2574 manager.go:1196] Started watching for new ooms in manager Jun 02 01:10:36.735094 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.735083 2574 manager.go:319] Starting recovery of all containers Jun 02 01:10:36.735419 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.734402 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-243.ec2.internal.18b51e62a56299f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-243.ec2.internal,UID:ip-10-0-139-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-243.ec2.internal,},FirstTimestamp:2026-06-02 01:10:36.725230064 +0000 UTC m=+0.432196374,LastTimestamp:2026-06-02 01:10:36.725230064 +0000 UTC m=+0.432196374,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-243.ec2.internal,}" Jun 02 01:10:36.742070 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.742038 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:10:36.742201 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.742133 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-243.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:10:36.746595 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.746579 2574 manager.go:324] Recovery completed Jun 02 01:10:36.747622 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.747605 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxs95" Jun 02 01:10:36.748026 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.748001 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 02 01:10:36.750881 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.750869 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.752698 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.752681 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.752753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.752708 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.752753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.752719 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.753209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.753189 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:10:36.753209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.753203 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:10:36.753308 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.753219 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:10:36.754753 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.754656 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-243.ec2.internal.18b51e62a705b553 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-243.ec2.internal,UID:ip-10-0-139-243.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-243.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-243.ec2.internal,},FirstTimestamp:2026-06-02 01:10:36.752696659 +0000 UTC m=+0.459662968,LastTimestamp:2026-06-02 01:10:36.752696659 +0000 UTC m=+0.459662968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-243.ec2.internal,}" Jun 02 01:10:36.755015 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.755004 2574 policy_none.go:49] "None policy: Start" Jun 02 01:10:36.755735 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.755020 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:10:36.755735 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.755030 2574 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:10:36.755735 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.755253 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gxs95" Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.791120 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.792284 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.792307 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.792323 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.792329 2574 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:10:36.793253 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.792364 2574 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 02 01:10:36.794369 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.794350 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:36.795549 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.795533 2574 manager.go:341] "Starting Device Plugin manager" Jun 02 01:10:36.795635 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.795617 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:10:36.795635 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.795628 2574 server.go:85] "Starting device plugin registration server" Jun 02 01:10:36.795888 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.795867 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:10:36.796018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.795888 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:10:36.796018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.795990 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:10:36.796130 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.796066 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:10:36.796130 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.796075 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:10:36.796605 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.796582 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:10:36.796694 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.796622 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:36.892800 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.892705 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal"] Jun 02 01:10:36.892922 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.892827 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.895206 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.895191 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.895300 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.895219 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.895300 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.895228 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.896265 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.896251 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.896355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.896337 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.896419 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.896394 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.896466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.896429 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.898980 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.898945 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.898980 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.898954 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.899120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.898994 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.899120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.898994 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.899120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899010 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.899120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899020 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.899120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899004 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.899309 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899148 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.899309 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899160 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.899309 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899178 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.899937 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899915 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.900037 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.899941 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:10:36.900597 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.900582 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:10:36.900675 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.900607 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:10:36.900675 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.900621 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:10:36.907754 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.907739 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.907828 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.907757 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-243.ec2.internal\": node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:36.926559 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.926539 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-243.ec2.internal\" not found" node="ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.930958 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.930944 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-243.ec2.internal\" not found" node="ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.933415 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:36.933393 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:36.935519 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.935502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.935621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.935533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:36.936007 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:36.935993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2adab5e9a55efbec8341207fb2d61ea-config\") pod \"kube-apiserver-proxy-ip-10-0-139-243.ec2.internal\" (UID: \"b2adab5e9a55efbec8341207fb2d61ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.034135 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.034091 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.036241 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036225 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.036305 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036252 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.036305 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036275 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2adab5e9a55efbec8341207fb2d61ea-config\") pod \"kube-apiserver-proxy-ip-10-0-139-243.ec2.internal\" (UID: \"b2adab5e9a55efbec8341207fb2d61ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.036394 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036309 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2adab5e9a55efbec8341207fb2d61ea-config\") pod \"kube-apiserver-proxy-ip-10-0-139-243.ec2.internal\" (UID: \"b2adab5e9a55efbec8341207fb2d61ea\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.036394 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.036394 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.036341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7795d311e6774811303da517cafcaaa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal\" (UID: \"f7795d311e6774811303da517cafcaaa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.134447 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.134403 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.228989 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.228917 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.234519 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.234494 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.234611 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.234553 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.334668 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.334617 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.435043 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.434999 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.535498 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.535422 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.635862 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:37.635832 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-243.ec2.internal\" not found" Jun 02 01:10:37.645070 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.645050 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:10:37.645212 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.645197 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:10:37.675097 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:37.675063 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2adab5e9a55efbec8341207fb2d61ea.slice/crio-42c0b17376c17d1d6d2cd2e7ef1db3dd35e6330aad70f9f0cc5398e0d9462aff WatchSource:0}: Error finding container 42c0b17376c17d1d6d2cd2e7ef1db3dd35e6330aad70f9f0cc5398e0d9462aff: Status 404 returned error can't find the container with id 42c0b17376c17d1d6d2cd2e7ef1db3dd35e6330aad70f9f0cc5398e0d9462aff Jun 02 01:10:37.675308 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:37.675292 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7795d311e6774811303da517cafcaaa.slice/crio-6f02f015d32fb542f311830776c9eb0466e3ffcb1a3ea2a93e9d976fc7174805 WatchSource:0}: Error finding container 6f02f015d32fb542f311830776c9eb0466e3ffcb1a3ea2a93e9d976fc7174805: Status 404 returned error can't find the container with id 6f02f015d32fb542f311830776c9eb0466e3ffcb1a3ea2a93e9d976fc7174805 Jun 02 01:10:37.679362 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.679348 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:10:37.723174 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.723154 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:37.733057 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.733033 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:10:37.734146 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.734124 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.747258 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.747235 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:10:37.748695 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.748672 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:37.750414 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.750400 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" Jun 02 01:10:37.756703 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.756666 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:05:36 +0000 UTC" deadline="2028-03-08 00:13:42.187297994 +0000 UTC" Jun 02 01:10:37.756752 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.756706 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15479h3m4.430596311s" Jun 02 01:10:37.758331 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.757067 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:10:37.768802 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.768785 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wl9jc" Jun 02 01:10:37.776557 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.776541 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wl9jc" Jun 02 01:10:37.795878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.795804 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" event={"ID":"b2adab5e9a55efbec8341207fb2d61ea","Type":"ContainerStarted","Data":"42c0b17376c17d1d6d2cd2e7ef1db3dd35e6330aad70f9f0cc5398e0d9462aff"} Jun 02 01:10:37.796823 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:37.796805 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" event={"ID":"f7795d311e6774811303da517cafcaaa","Type":"ContainerStarted","Data":"6f02f015d32fb542f311830776c9eb0466e3ffcb1a3ea2a93e9d976fc7174805"} Jun 02 01:10:38.110575 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.110507 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:38.143567 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.143545 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:38.712180 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.712149 2574 apiserver.go:52] "Watching apiserver" Jun 02 01:10:38.719888 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.719865 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:10:38.720272 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.720245 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw","openshift-cluster-node-tuning-operator/tuned-q5qn8","openshift-dns/node-resolver-h987k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal","openshift-multus/multus-additional-cni-plugins-mfc97","openshift-multus/multus-xl7d9","openshift-multus/network-metrics-daemon-cns8m","kube-system/konnectivity-agent-8fttr","openshift-image-registry/node-ca-2wmnp","openshift-network-diagnostics/network-check-target-9glg4","openshift-network-operator/iptables-alerter-tdrqh","openshift-ovn-kubernetes/ovnkube-node-p7rbj"] Jun 02 01:10:38.723013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.722985 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.723106 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.723084 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.725653 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.725631 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.725773 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.725715 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.725842 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.725805 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-w8975\"" Jun 02 01:10:38.726018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726002 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.726111 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726094 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lwqs7\"" Jun 02 01:10:38.726171 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726111 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.726171 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726112 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:10:38.726285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726261 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.726391 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.726374 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.727478 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.727442 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.728391 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.728364 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:10:38.728495 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.728441 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:10:38.728766 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.728635 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.728852 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.728768 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9sq9t\"" Jun 02 01:10:38.728852 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.728792 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.729654 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.729552 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4njkl\"" Jun 02 01:10:38.730153 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.729885 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.730153 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.729924 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.730303 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.730226 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57wjp\"" Jun 02 01:10:38.730303 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.730295 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:10:38.730397 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.730370 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:10:38.731371 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.731169 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.731371 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.731260 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:38.731503 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.731387 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.732843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.732821 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.733548 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.733470 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:10:38.733640 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.733470 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l8c6d\"" Jun 02 01:10:38.733640 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.733570 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:10:38.734870 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.734849 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:10:38.735131 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.735111 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.735223 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.735161 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.735282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.735226 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:38.735339 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.735290 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:38.735394 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.735360 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5rgxq\"" Jun 02 01:10:38.736439 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.736424 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.737843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.737823 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.738537 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.738519 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:10:38.738788 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.738731 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-drbbs\"" Jun 02 01:10:38.738788 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.738756 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.738788 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.738765 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.740111 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.740072 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:10:38.741386 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741301 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:10:38.741386 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741360 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:10:38.741386 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741379 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:10:38.741595 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741408 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:10:38.741595 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741361 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tq24g\"" Jun 02 01:10:38.741595 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.741363 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:10:38.743177 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-system-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-kubelet\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-hostroot\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-etc-kubernetes\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-lib-modules\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.743282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-624jr\" (UniqueName: \"kubernetes.io/projected/e183d1bb-1ca8-4af4-874c-2460440d1f96-kube-api-access-624jr\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abca0dbc-7c0a-4399-a9a5-ffa0def41541-agent-certs\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cnibin\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743431 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-os-release\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abca0dbc-7c0a-4399-a9a5-ffa0def41541-konnectivity-ca\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.743541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tb2n\" (UniqueName: \"kubernetes.io/projected/89f2be46-581c-4926-8631-dbff6e479f27-kube-api-access-9tb2n\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-conf\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-os-release\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-k8s-cni-cncf-io\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f2be46-581c-4926-8631-dbff6e479f27-hosts-file\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-systemd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-bin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-kubernetes\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743795 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.743898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-cnibin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-conf-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-serviceca\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.743983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ksd\" (UniqueName: \"kubernetes.io/projected/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-kube-api-access-j2ksd\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-host\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-tuned\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7f8\" (UniqueName: \"kubernetes.io/projected/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-kube-api-access-mk7f8\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-host\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-sys\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744218 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtfcj\" (UniqueName: \"kubernetes.io/projected/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kube-api-access-mtfcj\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744243 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f2be46-581c-4926-8631-dbff6e479f27-tmp-dir\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.744355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysconfig\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-tmp\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-socket-dir-parent\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-daemon-config\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-system-cni-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-modprobe-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-netns\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-multus-certs\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-run\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-var-lib-kubelet\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-multus\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.744857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744775 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-cni-binary-copy\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.745472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-device-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.745472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5jc\" (UniqueName: \"kubernetes.io/projected/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-kube-api-access-vn5jc\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.745472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.745472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.745472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.744866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr4rd\" (UniqueName: \"kubernetes.io/projected/b78f47b1-a7cd-42d2-ac1b-010045e597eb-kube-api-access-hr4rd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.777402 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.777367 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:37 +0000 UTC" deadline="2027-11-09 06:52:02.623380006 +0000 UTC" Jun 02 01:10:38.777402 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.777401 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12605h41m23.845983576s" Jun 02 01:10:38.834581 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.834551 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:10:38.845481 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845457 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.845609 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845548 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hr4rd\" (UniqueName: \"kubernetes.io/projected/b78f47b1-a7cd-42d2-ac1b-010045e597eb-kube-api-access-hr4rd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.845609 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845588 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-system-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845622 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-kubelet\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845647 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-hostroot\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845706 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-system-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845717 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-kubelet\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-hostroot\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845799 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-etc-kubernetes\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-slash\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845834 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-etc-kubernetes\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.845857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-node-log\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845871 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-lib-modules\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845893 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.845990 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-624jr\" (UniqueName: \"kubernetes.io/projected/e183d1bb-1ca8-4af4-874c-2460440d1f96-kube-api-access-624jr\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-lib-modules\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.845994 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846051 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846075 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abca0dbc-7c0a-4399-a9a5-ffa0def41541-agent-certs\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-etc-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.846119 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:39.346098786 +0000 UTC m=+3.053065105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-binary-copy\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.846142 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846148 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-socket-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-log-socket\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846211 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cnibin\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846236 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-os-release\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cnibin\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846260 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abca0dbc-7c0a-4399-a9a5-ffa0def41541-konnectivity-ca\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/063a0564-db64-414f-aa18-0a8f5d512b99-host-slash\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846311 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-os-release\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846341 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tb2n\" (UniqueName: \"kubernetes.io/projected/89f2be46-581c-4926-8631-dbff6e479f27-kube-api-access-9tb2n\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846393 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-conf\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-os-release\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846425 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-registration-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-os-release\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-conf\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846532 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-k8s-cni-cncf-io\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846563 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f2be46-581c-4926-8631-dbff6e479f27-hosts-file\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.846753 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-systemd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-k8s-cni-cncf-io\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-bin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89f2be46-581c-4926-8631-dbff6e479f27-hosts-file\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-bin\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-systemd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-script-lib\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-bin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846694 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-kubernetes\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846740 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-kubernetes\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846739 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846775 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-cnibin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-conf-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846854 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-serviceca\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846866 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-cni-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ksd\" (UniqueName: \"kubernetes.io/projected/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-kube-api-access-j2ksd\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.847621 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846883 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abca0dbc-7c0a-4399-a9a5-ffa0def41541-konnectivity-ca\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-config\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-cnibin\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-conf-dir\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.846938 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-host\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847020 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-tuned\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847048 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7f8\" (UniqueName: \"kubernetes.io/projected/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-kube-api-access-mk7f8\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847082 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-host\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-host\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-netns\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847184 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-env-overrides\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847227 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-sys\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pt4d\" (UniqueName: \"kubernetes.io/projected/063a0564-db64-414f-aa18-0a8f5d512b99-kube-api-access-7pt4d\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-serviceca\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2867\" (UniqueName: \"kubernetes.io/projected/7876d5a4-0515-40ed-ba3b-39b44df08775-kube-api-access-f2867\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847326 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtfcj\" (UniqueName: \"kubernetes.io/projected/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kube-api-access-mtfcj\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.848479 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-host\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847356 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-sys\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847381 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f2be46-581c-4926-8631-dbff6e479f27-tmp-dir\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847407 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847448 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysconfig\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-etc-selinux\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847473 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-tmp\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847499 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-socket-dir-parent\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847524 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-daemon-config\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847582 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847612 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-system-cni-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-socket-dir-parent\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847669 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-modprobe-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-netns\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysconfig\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847722 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-multus-certs\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/063a0564-db64-414f-aa18-0a8f5d512b99-iptables-alerter-script\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-kubelet\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847824 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847889 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-run\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89f2be46-581c-4926-8631-dbff6e479f27-tmp-dir\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-var-lib-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.847951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-ovn\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-netd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-netns\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848042 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848077 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-var-lib-kubelet\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-sys-fs\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848106 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-multus\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-var-lib-cni-multus\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7876d5a4-0515-40ed-ba3b-39b44df08775-ovn-node-metrics-cert\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848199 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.849917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848251 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-cni-binary-copy\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848266 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-run\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-systemd-units\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848307 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-device-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848336 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5jc\" (UniqueName: \"kubernetes.io/projected/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-kube-api-access-vn5jc\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848363 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-systemd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-multus-daemon-config\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-var-lib-kubelet\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-system-cni-dir\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-modprobe-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e183d1bb-1ca8-4af4-874c-2460440d1f96-host-run-multus-certs\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29a5b859-0e42-4304-92bc-e350d3ac1a1e-device-dir\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.848813 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-sysctl-d\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.850673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.849174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e183d1bb-1ca8-4af4-874c-2460440d1f96-cni-binary-copy\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.851450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.849530 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.851450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.849565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-etc-tuned\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.851450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.849847 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abca0dbc-7c0a-4399-a9a5-ffa0def41541-agent-certs\") pod \"konnectivity-agent-8fttr\" (UID: \"abca0dbc-7c0a-4399-a9a5-ffa0def41541\") " pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:38.851450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.850884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b78f47b1-a7cd-42d2-ac1b-010045e597eb-tmp\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.854910 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.854867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-624jr\" (UniqueName: \"kubernetes.io/projected/e183d1bb-1ca8-4af4-874c-2460440d1f96-kube-api-access-624jr\") pod \"multus-xl7d9\" (UID: \"e183d1bb-1ca8-4af4-874c-2460440d1f96\") " pod="openshift-multus/multus-xl7d9" Jun 02 01:10:38.855411 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.855390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr4rd\" (UniqueName: \"kubernetes.io/projected/b78f47b1-a7cd-42d2-ac1b-010045e597eb-kube-api-access-hr4rd\") pod \"tuned-q5qn8\" (UID: \"b78f47b1-a7cd-42d2-ac1b-010045e597eb\") " pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:38.855522 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.855511 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:38.855586 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.855528 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:38.855586 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.855541 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:38.855688 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:38.855596 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:10:39.355578134 +0000 UTC m=+3.062544446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:38.855900 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.855851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tb2n\" (UniqueName: \"kubernetes.io/projected/89f2be46-581c-4926-8631-dbff6e479f27-kube-api-access-9tb2n\") pod \"node-resolver-h987k\" (UID: \"89f2be46-581c-4926-8631-dbff6e479f27\") " pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:38.856167 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.856133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ksd\" (UniqueName: \"kubernetes.io/projected/8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce-kube-api-access-j2ksd\") pod \"node-ca-2wmnp\" (UID: \"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce\") " pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:38.856432 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.856378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7f8\" (UniqueName: \"kubernetes.io/projected/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-kube-api-access-mk7f8\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:38.856636 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.856614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtfcj\" (UniqueName: \"kubernetes.io/projected/29a5b859-0e42-4304-92bc-e350d3ac1a1e-kube-api-access-mtfcj\") pod \"aws-ebs-csi-driver-node-w49mw\" (UID: \"29a5b859-0e42-4304-92bc-e350d3ac1a1e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:38.857922 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.857904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5jc\" (UniqueName: \"kubernetes.io/projected/8b01b22e-855d-46c1-bb85-4c3e7e93ac00-kube-api-access-vn5jc\") pod \"multus-additional-cni-plugins-mfc97\" (UID: \"8b01b22e-855d-46c1-bb85-4c3e7e93ac00\") " pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:38.949693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949659 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-etc-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949707 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-log-socket\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949736 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/063a0564-db64-414f-aa18-0a8f5d512b99-host-slash\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-etc-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-log-socket\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949803 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-bin\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.949839 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949833 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-script-lib\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949847 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/063a0564-db64-414f-aa18-0a8f5d512b99-host-slash\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949855 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-config\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-bin\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949905 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-netns\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.949952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-netns\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950007 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950065 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-env-overrides\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950098 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7pt4d\" (UniqueName: \"kubernetes.io/projected/063a0564-db64-414f-aa18-0a8f5d512b99-kube-api-access-7pt4d\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950147 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2867\" (UniqueName: \"kubernetes.io/projected/7876d5a4-0515-40ed-ba3b-39b44df08775-kube-api-access-f2867\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950202 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950238 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/063a0564-db64-414f-aa18-0a8f5d512b99-iptables-alerter-script\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950272 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-kubelet\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950301 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-var-lib-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-run-ovn-kubernetes\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950324 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-ovn\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950349 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-netd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950368 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-kubelet\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7876d5a4-0515-40ed-ba3b-39b44df08775-ovn-node-metrics-cert\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950401 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-systemd-units\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-systemd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950448 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-var-lib-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950477 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-slash\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950501 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-node-log\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.950571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-systemd-units\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-ovn\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-systemd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-run-openvswitch\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-node-log\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-slash\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7876d5a4-0515-40ed-ba3b-39b44df08775-host-cni-netd\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950936 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/063a0564-db64-414f-aa18-0a8f5d512b99-iptables-alerter-script\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.950951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-script-lib\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.951079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-env-overrides\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.951363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.951303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7876d5a4-0515-40ed-ba3b-39b44df08775-ovnkube-config\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.952569 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.952549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7876d5a4-0515-40ed-ba3b-39b44df08775-ovn-node-metrics-cert\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.958649 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.958628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2867\" (UniqueName: \"kubernetes.io/projected/7876d5a4-0515-40ed-ba3b-39b44df08775-kube-api-access-f2867\") pod \"ovnkube-node-p7rbj\" (UID: \"7876d5a4-0515-40ed-ba3b-39b44df08775\") " pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:38.958856 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:38.958837 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pt4d\" (UniqueName: \"kubernetes.io/projected/063a0564-db64-414f-aa18-0a8f5d512b99-kube-api-access-7pt4d\") pod \"iptables-alerter-tdrqh\" (UID: \"063a0564-db64-414f-aa18-0a8f5d512b99\") " pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:39.035686 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.035607 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" Jun 02 01:10:39.043448 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.043421 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" Jun 02 01:10:39.051155 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.051136 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xl7d9" Jun 02 01:10:39.056313 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.056291 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h987k" Jun 02 01:10:39.063849 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.063831 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mfc97" Jun 02 01:10:39.069844 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.069827 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:39.075416 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.075399 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2wmnp" Jun 02 01:10:39.081939 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.081911 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdrqh" Jun 02 01:10:39.086601 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.086583 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:10:39.285947 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.285779 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f2be46_581c_4926_8631_dbff6e479f27.slice/crio-5f96ea9413cfa2d51bc0f89e2416a8c36ec4c82de802995d97dc64b167125121 WatchSource:0}: Error finding container 5f96ea9413cfa2d51bc0f89e2416a8c36ec4c82de802995d97dc64b167125121: Status 404 returned error can't find the container with id 5f96ea9413cfa2d51bc0f89e2416a8c36ec4c82de802995d97dc64b167125121 Jun 02 01:10:39.286845 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.286809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabca0dbc_7c0a_4399_a9a5_ffa0def41541.slice/crio-436f3febace9aae32937d880f09f8db609fb2b3e7a6a7a01a05b4f6e93f149a6 WatchSource:0}: Error finding container 436f3febace9aae32937d880f09f8db609fb2b3e7a6a7a01a05b4f6e93f149a6: Status 404 returned error can't find the container with id 436f3febace9aae32937d880f09f8db609fb2b3e7a6a7a01a05b4f6e93f149a6 Jun 02 01:10:39.287748 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.287649 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78f47b1_a7cd_42d2_ac1b_010045e597eb.slice/crio-5dce2dd93ddeddc561e3aa5b8fee203eca5bb71df1b0570e3cc8029f7d33399b WatchSource:0}: Error finding container 5dce2dd93ddeddc561e3aa5b8fee203eca5bb71df1b0570e3cc8029f7d33399b: Status 404 returned error can't find the container with id 5dce2dd93ddeddc561e3aa5b8fee203eca5bb71df1b0570e3cc8029f7d33399b Jun 02 01:10:39.290933 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.290912 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod063a0564_db64_414f_aa18_0a8f5d512b99.slice/crio-996c4a8b253e05b47dc7e75d8ccd6029c25fc04d2d42cde3aa9df705d407cef9 WatchSource:0}: Error finding container 996c4a8b253e05b47dc7e75d8ccd6029c25fc04d2d42cde3aa9df705d407cef9: Status 404 returned error can't find the container with id 996c4a8b253e05b47dc7e75d8ccd6029c25fc04d2d42cde3aa9df705d407cef9 Jun 02 01:10:39.292099 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.292078 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode183d1bb_1ca8_4af4_874c_2460440d1f96.slice/crio-421d3b748e7a9f5140ab5d0f3bfdc127270860765882c3569e279e8aba6e648f WatchSource:0}: Error finding container 421d3b748e7a9f5140ab5d0f3bfdc127270860765882c3569e279e8aba6e648f: Status 404 returned error can't find the container with id 421d3b748e7a9f5140ab5d0f3bfdc127270860765882c3569e279e8aba6e648f Jun 02 01:10:39.292748 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.292722 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7876d5a4_0515_40ed_ba3b_39b44df08775.slice/crio-cd7044e736fa73b677953c6665782057a129878d1dfec0719d843172c32ac735 WatchSource:0}: Error finding container cd7044e736fa73b677953c6665782057a129878d1dfec0719d843172c32ac735: Status 404 returned error can't find the container with id cd7044e736fa73b677953c6665782057a129878d1dfec0719d843172c32ac735 Jun 02 01:10:39.294837 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.294523 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a5b859_0e42_4304_92bc_e350d3ac1a1e.slice/crio-074f7dea71f7a86dc10040f671a6a29d6452ab756e0b5d26860fdbce7eda798d WatchSource:0}: Error finding container 074f7dea71f7a86dc10040f671a6a29d6452ab756e0b5d26860fdbce7eda798d: Status 404 returned error can't find the container with id 074f7dea71f7a86dc10040f671a6a29d6452ab756e0b5d26860fdbce7eda798d Jun 02 01:10:39.295561 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.295524 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4b6097_6a91_4ca2_8eac_ecaa40ef91ce.slice/crio-e9297b4670a5e2e50769ba38d4656bc4e2f3b6a59ca3af9432f1f29b276a01dc WatchSource:0}: Error finding container e9297b4670a5e2e50769ba38d4656bc4e2f3b6a59ca3af9432f1f29b276a01dc: Status 404 returned error can't find the container with id e9297b4670a5e2e50769ba38d4656bc4e2f3b6a59ca3af9432f1f29b276a01dc Jun 02 01:10:39.296485 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:10:39.296399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b01b22e_855d_46c1_bb85_4c3e7e93ac00.slice/crio-66b2484875a31ba97d6b18fc6b63d97fcd20d36f67e2d718510914352ee3844d WatchSource:0}: Error finding container 66b2484875a31ba97d6b18fc6b63d97fcd20d36f67e2d718510914352ee3844d: Status 404 returned error can't find the container with id 66b2484875a31ba97d6b18fc6b63d97fcd20d36f67e2d718510914352ee3844d Jun 02 01:10:39.354403 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.354376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:39.354554 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.354535 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:39.354621 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.354610 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:40.354587126 +0000 UTC m=+4.061553448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:39.455761 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.455725 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:39.455939 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.455899 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:39.455939 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.455925 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:39.455939 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.455938 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:39.456134 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:39.456019 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:10:40.455998255 +0000 UTC m=+4.162964563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:39.777974 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.777806 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:05:37 +0000 UTC" deadline="2027-11-11 11:21:04.059634496 +0000 UTC" Jun 02 01:10:39.777974 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.777864 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12658h10m24.281774918s" Jun 02 01:10:39.814260 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.814224 2574 generic.go:358] "Generic (PLEG): container finished" podID="f7795d311e6774811303da517cafcaaa" containerID="1e21bb89f444cf05beccaa072b87e8827c950a5563451c23f4c65e7f34c73d85" exitCode=0 Jun 02 01:10:39.814443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.814306 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" event={"ID":"f7795d311e6774811303da517cafcaaa","Type":"ContainerDied","Data":"1e21bb89f444cf05beccaa072b87e8827c950a5563451c23f4c65e7f34c73d85"} Jun 02 01:10:39.818724 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.818252 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2wmnp" event={"ID":"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce","Type":"ContainerStarted","Data":"e9297b4670a5e2e50769ba38d4656bc4e2f3b6a59ca3af9432f1f29b276a01dc"} Jun 02 01:10:39.822809 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.822775 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" event={"ID":"29a5b859-0e42-4304-92bc-e350d3ac1a1e","Type":"ContainerStarted","Data":"074f7dea71f7a86dc10040f671a6a29d6452ab756e0b5d26860fdbce7eda798d"} Jun 02 01:10:39.826989 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.826947 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" event={"ID":"b78f47b1-a7cd-42d2-ac1b-010045e597eb","Type":"ContainerStarted","Data":"5dce2dd93ddeddc561e3aa5b8fee203eca5bb71df1b0570e3cc8029f7d33399b"} Jun 02 01:10:39.841047 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.840553 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerStarted","Data":"66b2484875a31ba97d6b18fc6b63d97fcd20d36f67e2d718510914352ee3844d"} Jun 02 01:10:39.851924 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.851896 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"cd7044e736fa73b677953c6665782057a129878d1dfec0719d843172c32ac735"} Jun 02 01:10:39.865013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.864986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl7d9" event={"ID":"e183d1bb-1ca8-4af4-874c-2460440d1f96","Type":"ContainerStarted","Data":"421d3b748e7a9f5140ab5d0f3bfdc127270860765882c3569e279e8aba6e648f"} Jun 02 01:10:39.884037 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.883986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdrqh" event={"ID":"063a0564-db64-414f-aa18-0a8f5d512b99","Type":"ContainerStarted","Data":"996c4a8b253e05b47dc7e75d8ccd6029c25fc04d2d42cde3aa9df705d407cef9"} Jun 02 01:10:39.899587 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.899420 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fttr" event={"ID":"abca0dbc-7c0a-4399-a9a5-ffa0def41541","Type":"ContainerStarted","Data":"436f3febace9aae32937d880f09f8db609fb2b3e7a6a7a01a05b4f6e93f149a6"} Jun 02 01:10:39.915419 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.915361 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h987k" event={"ID":"89f2be46-581c-4926-8631-dbff6e479f27","Type":"ContainerStarted","Data":"5f96ea9413cfa2d51bc0f89e2416a8c36ec4c82de802995d97dc64b167125121"} Jun 02 01:10:39.932293 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:39.932139 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" event={"ID":"b2adab5e9a55efbec8341207fb2d61ea","Type":"ContainerStarted","Data":"eaeaccc0ef08ef58e38a41cd415b565888d645596527f16d92a6cd3755c311b0"} Jun 02 01:10:40.364219 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.364104 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:40.364390 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.364261 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:40.364390 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.364334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:42.364314524 +0000 UTC m=+6.071280844 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:40.465543 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.465364 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:40.465543 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.465507 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:40.465543 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.465531 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:40.465543 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.465545 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:40.465941 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.465602 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:10:42.46558437 +0000 UTC m=+6.172550685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:40.794185 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.794115 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:40.794604 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.794254 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:40.794763 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.794743 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:40.794860 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:40.794840 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:40.953481 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.952912 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" event={"ID":"f7795d311e6774811303da517cafcaaa","Type":"ContainerStarted","Data":"9c458bcbf5bbf85eefcef60c117c99218c8d60bb1b0143c752aae817a969eead"} Jun 02 01:10:40.967684 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.967575 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-243.ec2.internal" podStartSLOduration=3.96755775 podStartE2EDuration="3.96755775s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:10:39.948128874 +0000 UTC m=+3.655095195" watchObservedRunningTime="2026-06-02 01:10:40.96755775 +0000 UTC m=+4.674524062" Jun 02 01:10:40.967948 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:40.967912 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-243.ec2.internal" podStartSLOduration=3.967899081 podStartE2EDuration="3.967899081s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:10:40.967535843 +0000 UTC m=+4.674502164" watchObservedRunningTime="2026-06-02 01:10:40.967899081 +0000 UTC m=+4.674865401" Jun 02 01:10:41.895052 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:41.895016 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-np4n4"] Jun 02 01:10:41.897743 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:41.897108 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:41.897743 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:41.897276 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:41.977466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:41.977430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:41.977671 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:41.977509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-kubelet-config\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:41.977671 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:41.977539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-dbus\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.078285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.078245 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.078462 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.078320 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-kubelet-config\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.078462 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.078348 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-dbus\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.078578 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.078524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-dbus\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.078664 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.078633 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:42.078723 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.078696 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:10:42.578677919 +0000 UTC m=+6.285644224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:42.078986 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.078947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23898999-3e85-4d71-b2b3-2497238e9dcb-kubelet-config\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.381543 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.381465 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:42.381726 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.381681 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:42.381790 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.381750 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:46.381732002 +0000 UTC m=+10.088698316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:42.482796 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.482758 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:42.483032 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.482939 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:42.483032 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.482976 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:42.483032 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.482990 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:42.483242 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.483052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:10:46.483031778 +0000 UTC m=+10.189998098 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:42.583416 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.583230 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:42.583577 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.583431 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:42.583577 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.583500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:10:43.583481355 +0000 UTC m=+7.290447656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:42.793875 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.793798 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:42.793875 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:42.793855 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:42.794086 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.793978 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:42.794141 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:42.794081 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:43.592564 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:43.592526 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:43.593029 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:43.592643 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:43.593029 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:43.592718 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:10:45.592698541 +0000 UTC m=+9.299664854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:43.793817 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:43.793784 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:43.793996 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:43.793915 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:44.792552 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:44.792515 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:44.793013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:44.792570 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:44.793013 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:44.792686 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:44.793164 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:44.793116 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:45.608483 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:45.608427 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:45.608678 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:45.608576 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:45.608678 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:45.608647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:10:49.608627454 +0000 UTC m=+13.315593751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:45.792873 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:45.792456 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:45.792873 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:45.792585 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:46.414486 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:46.414425 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:46.414752 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.414584 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:46.414752 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.414650 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:10:54.414629756 +0000 UTC m=+18.121596070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:46.515602 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:46.515561 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:46.515765 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.515738 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:46.515765 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.515759 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:46.515862 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.515771 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:46.515862 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.515832 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:10:54.515810298 +0000 UTC m=+18.222776640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:46.793946 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:46.793905 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:46.794459 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.794066 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:46.794459 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:46.794434 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:46.794586 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:46.794537 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:47.792810 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:47.792710 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:47.793051 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:47.792842 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:48.793458 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:48.793415 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:48.793890 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:48.793556 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:48.793890 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:48.793619 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:48.793890 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:48.793756 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:49.642690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:49.642638 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:49.642852 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:49.642801 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:49.642901 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:49.642867 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:10:57.642847654 +0000 UTC m=+21.349813954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:49.792940 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:49.792911 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:49.793125 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:49.793023 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:50.793188 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:50.793153 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:50.793623 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:50.793153 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:50.793623 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:50.793289 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:50.793623 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:50.793376 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:51.793022 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:51.792984 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:51.793198 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:51.793102 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:52.793432 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:52.793399 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:52.793843 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:52.793516 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:52.793843 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:52.793603 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:52.793843 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:52.793711 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:53.793520 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:53.793484 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:53.793937 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:53.793605 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:54.481483 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:54.481441 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:54.481685 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.481575 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:54.481685 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.481634 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:10.481615072 +0000 UTC m=+34.188581377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:10:54.582249 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:54.582210 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:54.582429 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.582371 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:10:54.582429 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.582402 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:10:54.582429 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.582416 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:54.582598 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.582473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:11:10.582457063 +0000 UTC m=+34.289423369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:10:54.793178 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:54.793144 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:54.793348 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:54.793149 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:54.793348 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.793268 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:54.793447 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:54.793369 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:55.793146 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:55.793114 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:55.793597 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:55.793240 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:56.793475 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:56.793439 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:56.793869 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:56.793536 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:56.793869 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:56.793590 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:56.793869 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:56.793673 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:57.705487 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.705328 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:57.705580 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:57.705455 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:57.705647 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:57.705602 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret podName:23898999-3e85-4d71-b2b3-2497238e9dcb nodeName:}" failed. No retries permitted until 2026-06-02 01:11:13.705582277 +0000 UTC m=+37.412548591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret") pod "global-pull-secret-syncer-np4n4" (UID: "23898999-3e85-4d71-b2b3-2497238e9dcb") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:10:57.792490 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.792467 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:57.792604 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:57.792563 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:57.984010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.983983 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="eb621b11d3cdc6da8e7f2619d7de069eba217971dd0a87facd844666085da204" exitCode=0 Jun 02 01:10:57.984630 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.984064 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"eb621b11d3cdc6da8e7f2619d7de069eba217971dd0a87facd844666085da204"} Jun 02 01:10:57.986881 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.986860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:10:57.987320 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.987272 2574 generic.go:358] "Generic (PLEG): container finished" podID="7876d5a4-0515-40ed-ba3b-39b44df08775" containerID="5812fd89a5fe8cce43833716fb65c4630be31400843cd5ee5cb04f9f78f53431" exitCode=1 Jun 02 01:10:57.987409 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.987312 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"83a92165cf5d6f7ac57b4f383042e76b49996f7c043c8a9ee1b76939e45f7377"} Jun 02 01:10:57.987409 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.987400 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"1a5231ce463aa251bd728e56a7499c401a88a33bafd82cb3c4767bfc3300de36"} Jun 02 01:10:57.987500 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.987414 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerDied","Data":"5812fd89a5fe8cce43833716fb65c4630be31400843cd5ee5cb04f9f78f53431"} Jun 02 01:10:57.987500 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.987425 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"3e720c32d325844c36e8038d182b83d60d1853c86f5dbfce2dc10c10234deae2"} Jun 02 01:10:57.989021 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.988992 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xl7d9" event={"ID":"e183d1bb-1ca8-4af4-874c-2460440d1f96","Type":"ContainerStarted","Data":"a08273e0ecb52a05ed84384df1d2bffdc26e0bf0d163dc90e4424d99450e9b38"} Jun 02 01:10:57.990549 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.990530 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8fttr" event={"ID":"abca0dbc-7c0a-4399-a9a5-ffa0def41541","Type":"ContainerStarted","Data":"d6ddaaeb785e5465792100930a08a2b09baf877d2d00a1dea62a52757d2b1711"} Jun 02 01:10:57.992013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.991992 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h987k" event={"ID":"89f2be46-581c-4926-8631-dbff6e479f27","Type":"ContainerStarted","Data":"805557a05b6dcb882f80c7154a810bcafa7a3461b2c1b6cb5f8a501aaf59623b"} Jun 02 01:10:57.993456 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.993434 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2wmnp" event={"ID":"8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce","Type":"ContainerStarted","Data":"e0000f9cb73a8ac4681cd974f5d433846560abed20c8635f1ec7d9da527b2d8d"} Jun 02 01:10:57.994986 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.994936 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" event={"ID":"29a5b859-0e42-4304-92bc-e350d3ac1a1e","Type":"ContainerStarted","Data":"ac2f371bb766bd187c79121c0c4b1b15603e607f4cef8da6217b54ed57989bec"} Jun 02 01:10:57.996519 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:57.996497 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" event={"ID":"b78f47b1-a7cd-42d2-ac1b-010045e597eb","Type":"ContainerStarted","Data":"38f7bb392f99a86aa8ac1422358ab99b78fc5cfe6730cd450bbe09395423024e"} Jun 02 01:10:58.020112 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.020068 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-h987k" podStartSLOduration=3.079261047 podStartE2EDuration="21.020056613s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.287687994 +0000 UTC m=+2.994654294" lastFinishedPulling="2026-06-02 01:10:57.228483555 +0000 UTC m=+20.935449860" observedRunningTime="2026-06-02 01:10:58.019615829 +0000 UTC m=+21.726582151" watchObservedRunningTime="2026-06-02 01:10:58.020056613 +0000 UTC m=+21.727022929" Jun 02 01:10:58.035396 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.035347 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-xl7d9" podStartSLOduration=3.082379237 podStartE2EDuration="21.035332251s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.29375485 +0000 UTC m=+3.000721147" lastFinishedPulling="2026-06-02 01:10:57.246707863 +0000 UTC m=+20.953674161" observedRunningTime="2026-06-02 01:10:58.034779126 +0000 UTC m=+21.741745446" watchObservedRunningTime="2026-06-02 01:10:58.035332251 +0000 UTC m=+21.742298571" Jun 02 01:10:58.048262 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.048084 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8fttr" podStartSLOduration=7.852996955 podStartE2EDuration="21.048068167s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.288679089 +0000 UTC m=+2.995645389" lastFinishedPulling="2026-06-02 01:10:52.483750291 +0000 UTC m=+16.190716601" observedRunningTime="2026-06-02 01:10:58.047280874 +0000 UTC m=+21.754247205" watchObservedRunningTime="2026-06-02 01:10:58.048068167 +0000 UTC m=+21.755034488" Jun 02 01:10:58.060268 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.060222 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2wmnp" podStartSLOduration=3.12920793 podStartE2EDuration="21.060208171s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.297416121 +0000 UTC m=+3.004382420" lastFinishedPulling="2026-06-02 01:10:57.22841635 +0000 UTC m=+20.935382661" observedRunningTime="2026-06-02 01:10:58.060037379 +0000 UTC m=+21.767003698" watchObservedRunningTime="2026-06-02 01:10:58.060208171 +0000 UTC m=+21.767174490" Jun 02 01:10:58.077625 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.077581 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q5qn8" podStartSLOduration=4.1346652 podStartE2EDuration="22.077566316s" podCreationTimestamp="2026-06-02 01:10:36 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.289614065 +0000 UTC m=+2.996580370" lastFinishedPulling="2026-06-02 01:10:57.232515175 +0000 UTC m=+20.939481486" observedRunningTime="2026-06-02 01:10:58.07751913 +0000 UTC m=+21.784485477" watchObservedRunningTime="2026-06-02 01:10:58.077566316 +0000 UTC m=+21.784532636" Jun 02 01:10:58.105503 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.105484 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:58.106063 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.106045 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:58.792816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.792793 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:10:58.793084 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:58.792874 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:10:58.793084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.792889 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:10:58.793084 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:58.793018 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:10:58.990912 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.990728 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:10:58.999902 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:58.999878 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" event={"ID":"29a5b859-0e42-4304-92bc-e350d3ac1a1e","Type":"ContainerStarted","Data":"374737abdc9ec0c49afe5ffd2a24f27bc625e0c225d6fbb53fdeb95e4ec03ef3"} Jun 02 01:10:59.002515 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.002491 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:10:59.002853 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.002831 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"6d55452f26e5f15a1931d23a8f588769c9d163d5b8e48e1ed84435a6b21f1122"} Jun 02 01:10:59.002853 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.002858 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"64ab92f22dff41dc11fc40ef5456aeb9af11532fb64c2b9c1a5a32fd32787752"} Jun 02 01:10:59.004345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.004311 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdrqh" event={"ID":"063a0564-db64-414f-aa18-0a8f5d512b99","Type":"ContainerStarted","Data":"32c6374ce5a2726e5cf696c35efece1d8b2da421bbcd84a21d9328528d838b02"} Jun 02 01:10:59.005461 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.005408 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:59.005543 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.005461 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8fttr" Jun 02 01:10:59.031312 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.031269 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tdrqh" podStartSLOduration=4.09564939 podStartE2EDuration="22.031258547s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.292787838 +0000 UTC m=+2.999754139" lastFinishedPulling="2026-06-02 01:10:57.228396992 +0000 UTC m=+20.935363296" observedRunningTime="2026-06-02 01:10:59.017293352 +0000 UTC m=+22.724259671" watchObservedRunningTime="2026-06-02 01:10:59.031258547 +0000 UTC m=+22.738224919" Jun 02 01:10:59.792683 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.792645 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:10:59.792866 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:10:59.792765 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:10:59.809005 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.808886 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:10:58.990908261Z","UUID":"305e4c9c-7145-4407-8d36-6051657b4474","Handler":null,"Name":"","Endpoint":""} Jun 02 01:10:59.812333 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.812303 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:10:59.812333 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:10:59.812336 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:11:00.792769 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:00.792740 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:00.793281 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:00.792852 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:00.793281 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:00.792937 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:00.793281 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:00.793062 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:01.011529 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:01.011501 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:11:01.011905 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:01.011860 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"796ca049508fcbc467a5706ae0233957a707f9c785e5058a2899aa5573f6dedd"} Jun 02 01:11:01.013823 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:01.013784 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" event={"ID":"29a5b859-0e42-4304-92bc-e350d3ac1a1e","Type":"ContainerStarted","Data":"a7f9a31e8c09baa5b659970379ee0932da191abb294a27935ff43ef1f1c57f82"} Jun 02 01:11:01.030284 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:01.030243 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-w49mw" podStartSLOduration=3.492242071 podStartE2EDuration="25.030228092s" podCreationTimestamp="2026-06-02 01:10:36 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.296025812 +0000 UTC m=+3.002992109" lastFinishedPulling="2026-06-02 01:11:00.834011819 +0000 UTC m=+24.540978130" observedRunningTime="2026-06-02 01:11:01.029851172 +0000 UTC m=+24.736817492" watchObservedRunningTime="2026-06-02 01:11:01.030228092 +0000 UTC m=+24.737194411" Jun 02 01:11:01.792755 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:01.792713 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:01.792938 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:01.792823 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:11:02.792893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:02.792857 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:02.793084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:02.792870 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:02.793084 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:02.792993 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:02.793618 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:02.793100 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:03.793410 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:03.793121 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:03.794111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:03.793439 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:11:04.021567 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.021462 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="3a012198bdc14453d4e615b2864c533ea9cc64f896daabbd6d1179c8299510b1" exitCode=0 Jun 02 01:11:04.021700 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.021553 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"3a012198bdc14453d4e615b2864c533ea9cc64f896daabbd6d1179c8299510b1"} Jun 02 01:11:04.024549 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.024532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:11:04.024883 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.024859 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"b910459fdf5fc87b509dd2dd54de9b49e122b016e7a7e84f4fcc540fdf7c005d"} Jun 02 01:11:04.025128 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.025106 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:04.025226 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.025137 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:04.025296 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.025283 2574 scope.go:117] "RemoveContainer" containerID="5812fd89a5fe8cce43833716fb65c4630be31400843cd5ee5cb04f9f78f53431" Jun 02 01:11:04.040816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.040794 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:04.792762 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.792737 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:04.792849 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:04.792782 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:04.792895 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:04.792859 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:04.793020 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:04.792990 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:05.029749 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.029720 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="fa4de0be4373ed9a8ce312f4e6440a69abe3af5ce226dfd4c33a55cbbf9177c1" exitCode=0 Jun 02 01:11:05.030167 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.029793 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"fa4de0be4373ed9a8ce312f4e6440a69abe3af5ce226dfd4c33a55cbbf9177c1"} Jun 02 01:11:05.033346 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.033326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:11:05.033682 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.033656 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" event={"ID":"7876d5a4-0515-40ed-ba3b-39b44df08775","Type":"ContainerStarted","Data":"fe27f491440bcfd626118d6171cfab650d18e5c989cba68a5f05f8bdb4558943"} Jun 02 01:11:05.034018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.033997 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:05.047822 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.047804 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:05.073075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.073041 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" podStartSLOduration=9.76032422 podStartE2EDuration="28.073029946s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.295588309 +0000 UTC m=+3.002554607" lastFinishedPulling="2026-06-02 01:10:57.608294036 +0000 UTC m=+21.315260333" observedRunningTime="2026-06-02 01:11:05.071513127 +0000 UTC m=+28.778479447" watchObservedRunningTime="2026-06-02 01:11:05.073029946 +0000 UTC m=+28.779996264" Jun 02 01:11:05.663769 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.663732 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9glg4"] Jun 02 01:11:05.663937 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.663849 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:05.664031 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:05.663953 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:05.666239 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.666212 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cns8m"] Jun 02 01:11:05.666354 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.666318 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:05.666449 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:05.666424 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:05.675249 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.675227 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-np4n4"] Jun 02 01:11:05.675331 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:05.675317 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:05.675429 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:05.675406 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:11:06.037345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:06.037312 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="0daf31c4c79046fa89c047f5dd2b358e732b9a12f61a8f34acf2720fbca52b90" exitCode=0 Jun 02 01:11:06.037791 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:06.037391 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"0daf31c4c79046fa89c047f5dd2b358e732b9a12f61a8f34acf2720fbca52b90"} Jun 02 01:11:06.794345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:06.794129 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:06.794511 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:06.794208 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:06.794511 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:06.794462 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:06.794618 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:06.794508 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:11:07.793018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:07.792983 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:07.793627 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:07.793104 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:08.793561 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:08.793529 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:08.794151 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:08.793529 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:08.794151 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:08.793670 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cns8m" podUID="d6b04cb3-93e1-4110-a31b-88b4fd21a5b3" Jun 02 01:11:08.794151 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:08.793737 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-np4n4" podUID="23898999-3e85-4d71-b2b3-2497238e9dcb" Jun 02 01:11:09.792510 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:09.792480 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:09.792645 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:09.792576 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9glg4" podUID="8daa06c1-9a4c-4575-8115-f836c5bfa8ac" Jun 02 01:11:10.157366 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.157291 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-243.ec2.internal" event="NodeReady" Jun 02 01:11:10.157873 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.157425 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:11:10.211586 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.211552 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b4c4fdc8-wtwrq"] Jun 02 01:11:10.214647 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.214622 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.218214 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.218192 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:11:10.220222 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.220190 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6zdsw\"" Jun 02 01:11:10.220357 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.220324 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:11:10.220416 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.220362 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:11:10.226426 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.226407 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:11:10.229868 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.229848 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b4c4fdc8-wtwrq"] Jun 02 01:11:10.232575 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.232554 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-98ph6"] Jun 02 01:11:10.234360 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.234342 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.237353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.236733 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:11:10.237353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.236920 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:11:10.237353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.237206 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:11:10.237353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.237290 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:11:10.244263 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.244243 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98ph6"] Jun 02 01:11:10.321848 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.321806 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8q6qf"] Jun 02 01:11:10.323748 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.323723 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.326109 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.326083 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:11:10.326200 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.326121 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:11:10.326382 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.326365 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:11:10.332891 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.332854 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q6qf"] Jun 02 01:11:10.405055 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405198 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405063 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.405198 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405198 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsk4c\" (UniqueName: \"kubernetes.io/projected/68b1b821-9cfd-44c0-82d7-71129551079f-kube-api-access-hsk4c\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.405368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqzx\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405530 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.405530 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.405427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.505841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.505755 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.505841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.505805 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.505841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.505836 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.505867 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506009 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506030 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506051 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506084 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:11.006067792 +0000 UTC m=+34.713034094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506110 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:11.006091484 +0000 UTC m=+34.713057790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:10.506149 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506182 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506190 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506258 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506292 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsk4c\" (UniqueName: \"kubernetes.io/projected/68b1b821-9cfd-44c0-82d7-71129551079f-kube-api-access-hsk4c\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/990d3632-d0a1-43f5-8d8c-d0149df6d297-config-volume\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506347 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506346 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990d3632-d0a1-43f5-8d8c-d0149df6d297-tmp-dir\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.506441 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.506408 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:42.506393051 +0000 UTC m=+66.213359365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506452 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506492 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqzx\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506532 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506565 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjll4\" (UniqueName: \"kubernetes.io/projected/990d3632-d0a1-43f5-8d8c-d0149df6d297-kube-api-access-jjll4\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.506681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.506598 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.507455 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.507432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.512053 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.512029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.512168 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.512048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.515807 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.515660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsk4c\" (UniqueName: \"kubernetes.io/projected/68b1b821-9cfd-44c0-82d7-71129551079f-kube-api-access-hsk4c\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:10.515907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.515682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.516001 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.515957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqzx\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:10.607729 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.607687 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjll4\" (UniqueName: \"kubernetes.io/projected/990d3632-d0a1-43f5-8d8c-d0149df6d297-kube-api-access-jjll4\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.607906 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.607734 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:10.607906 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.607784 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.607906 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.607822 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/990d3632-d0a1-43f5-8d8c-d0149df6d297-config-volume\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.607906 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.607848 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990d3632-d0a1-43f5-8d8c-d0149df6d297-tmp-dir\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.608102 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.607913 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:11:10.608102 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.607942 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:11:10.608102 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.607957 2574 projected.go:194] Error preparing data for projected volume kube-api-access-bmn4t for pod openshift-network-diagnostics/network-check-target-9glg4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:10.608102 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.607922 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:10.608102 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.608028 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t podName:8daa06c1-9a4c-4575-8115-f836c5bfa8ac nodeName:}" failed. No retries permitted until 2026-06-02 01:11:42.608009072 +0000 UTC m=+66.314975386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bmn4t" (UniqueName: "kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t") pod "network-check-target-9glg4" (UID: "8daa06c1-9a4c-4575-8115-f836c5bfa8ac") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:11:10.608359 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:10.608112 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:11.108091382 +0000 UTC m=+34.815057693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:10.608359 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.608216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990d3632-d0a1-43f5-8d8c-d0149df6d297-tmp-dir\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.608473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.608450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/990d3632-d0a1-43f5-8d8c-d0149df6d297-config-volume\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.615916 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.615896 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjll4\" (UniqueName: \"kubernetes.io/projected/990d3632-d0a1-43f5-8d8c-d0149df6d297-kube-api-access-jjll4\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:10.793172 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.793135 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:10.793328 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.793185 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:10.795907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.795772 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:11:10.795907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.795808 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:11:10.795907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:10.795779 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:11:11.010586 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.010553 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:11.010586 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.010599 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:11.010824 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.010763 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:11.010824 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.010780 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:11.010918 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.010833 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:12.010816852 +0000 UTC m=+35.717783166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:11.011114 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.011087 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:11.011231 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.011145 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:12.011130204 +0000 UTC m=+35.718096505 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:11.111110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.111022 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:11.111264 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.111207 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:11.111327 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:11.111283 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:12.111262236 +0000 UTC m=+35.818228547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:11.792982 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.792935 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:11.795913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.795870 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:11:11.795913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.795883 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:11:11.795913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:11.795915 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:11:12.018320 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:12.018285 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:12.018471 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:12.018328 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:12.018471 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.018422 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:12.018471 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.018429 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:12.018471 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.018444 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:12.018636 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.018487 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:14.018465376 +0000 UTC m=+37.725431673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:12.018636 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.018549 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:14.018531126 +0000 UTC m=+37.725497426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:12.119091 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:12.119032 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:12.119192 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.119139 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:12.119192 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:12.119185 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:14.119170138 +0000 UTC m=+37.826136438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:13.052400 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.052370 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="53a257493fd76c76b63b1f285b827b08204c639f8ff7830397312a28ad8a27ca" exitCode=0 Jun 02 01:11:13.052738 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.052414 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"53a257493fd76c76b63b1f285b827b08204c639f8ff7830397312a28ad8a27ca"} Jun 02 01:11:13.729065 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.729021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:13.732196 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.732173 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23898999-3e85-4d71-b2b3-2497238e9dcb-original-pull-secret\") pod \"global-pull-secret-syncer-np4n4\" (UID: \"23898999-3e85-4d71-b2b3-2497238e9dcb\") " pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:13.809873 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.809846 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-np4n4" Jun 02 01:11:13.954398 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:13.954247 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-np4n4"] Jun 02 01:11:13.959384 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:11:13.959357 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23898999_3e85_4d71_b2b3_2497238e9dcb.slice/crio-f1ce32fdff9ed1fa7331aaf7b71b4f4cfa2956dbebf7ec8fddc2e8f6a87c1a69 WatchSource:0}: Error finding container f1ce32fdff9ed1fa7331aaf7b71b4f4cfa2956dbebf7ec8fddc2e8f6a87c1a69: Status 404 returned error can't find the container with id f1ce32fdff9ed1fa7331aaf7b71b4f4cfa2956dbebf7ec8fddc2e8f6a87c1a69 Jun 02 01:11:14.031437 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.031408 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:14.031548 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.031462 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:14.031587 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.031546 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:14.031620 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.031599 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:14.031620 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.031617 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:14.031699 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.031603 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:18.031588649 +0000 UTC m=+41.738554950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:14.031699 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.031674 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:18.031658516 +0000 UTC m=+41.738624818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:14.054945 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.054923 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-np4n4" event={"ID":"23898999-3e85-4d71-b2b3-2497238e9dcb","Type":"ContainerStarted","Data":"f1ce32fdff9ed1fa7331aaf7b71b4f4cfa2956dbebf7ec8fddc2e8f6a87c1a69"} Jun 02 01:11:14.057492 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.057471 2574 generic.go:358] "Generic (PLEG): container finished" podID="8b01b22e-855d-46c1-bb85-4c3e7e93ac00" containerID="3f29ff2131b7dfec7914154b8c29fc88ff5ed9624f038db9cc2065b87ddb7c30" exitCode=0 Jun 02 01:11:14.057590 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.057516 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerDied","Data":"3f29ff2131b7dfec7914154b8c29fc88ff5ed9624f038db9cc2065b87ddb7c30"} Jun 02 01:11:14.132012 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:14.131988 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:14.132119 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.132103 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:14.132165 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:14.132155 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:18.13214112 +0000 UTC m=+41.839107438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:15.063212 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:15.063179 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mfc97" event={"ID":"8b01b22e-855d-46c1-bb85-4c3e7e93ac00","Type":"ContainerStarted","Data":"b5b6cfb21d5021851419a54cf687683ebda1743cdafd2df70efeffdd38369908"} Jun 02 01:11:15.085898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:15.085639 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mfc97" podStartSLOduration=4.990865025 podStartE2EDuration="38.085623117s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:10:39.297908488 +0000 UTC m=+3.004874785" lastFinishedPulling="2026-06-02 01:11:12.392666568 +0000 UTC m=+36.099632877" observedRunningTime="2026-06-02 01:11:15.085204858 +0000 UTC m=+38.792171190" watchObservedRunningTime="2026-06-02 01:11:15.085623117 +0000 UTC m=+38.792589437" Jun 02 01:11:18.058711 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:18.058676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:18.058711 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:18.058715 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:18.059111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.058810 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:18.059111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.058810 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:18.059111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.058881 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:26.058865969 +0000 UTC m=+49.765832267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:18.059111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.058821 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:18.059111 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.058916 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:26.058909964 +0000 UTC m=+49.765876260 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:18.159283 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:18.159252 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:18.159436 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.159361 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:18.159436 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:18.159409 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:26.159394984 +0000 UTC m=+49.866361282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:19.073102 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:19.073064 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-np4n4" event={"ID":"23898999-3e85-4d71-b2b3-2497238e9dcb","Type":"ContainerStarted","Data":"a2941bd7904858e83b31f9fd39a8359d582f080ee9387acc2b7fa2276cf72bc4"} Jun 02 01:11:19.090373 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:19.090325 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-np4n4" podStartSLOduration=33.649561518 podStartE2EDuration="38.09030757s" podCreationTimestamp="2026-06-02 01:10:41 +0000 UTC" firstStartedPulling="2026-06-02 01:11:13.96125093 +0000 UTC m=+37.668217227" lastFinishedPulling="2026-06-02 01:11:18.401996982 +0000 UTC m=+42.108963279" observedRunningTime="2026-06-02 01:11:19.090002555 +0000 UTC m=+42.796968868" watchObservedRunningTime="2026-06-02 01:11:19.09030757 +0000 UTC m=+42.797273963" Jun 02 01:11:26.110874 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:26.110834 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:26.110874 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:26.110878 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:26.111426 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.111002 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:26.111426 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.111069 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:11:42.1110511 +0000 UTC m=+65.818017417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:26.111426 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.111072 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:26.111426 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.111093 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:26.111426 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.111164 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:42.111145738 +0000 UTC m=+65.818112057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:26.211533 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:26.211495 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:26.211736 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.211640 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:26.211736 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:26.211715 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:11:42.211698751 +0000 UTC m=+65.918665048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:37.049318 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:37.049289 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p7rbj" Jun 02 01:11:42.124417 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.124377 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:11:42.124417 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.124422 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:11:42.124821 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.124513 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:11:42.124821 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.124534 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:11:42.124821 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.124545 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:11:42.124821 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.124568 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:12:14.124554006 +0000 UTC m=+97.831520307 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:11:42.124821 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.124591 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:14.124579391 +0000 UTC m=+97.831545687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:11:42.225550 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.225513 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:11:42.225744 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.225651 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:11:42.225744 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.225727 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:14.225712682 +0000 UTC m=+97.932678980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:11:42.528163 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.528136 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:11:42.530819 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.530803 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:11:42.538854 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.538831 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:11:42.538911 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:11:42.538889 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs podName:d6b04cb3-93e1-4110-a31b-88b4fd21a5b3 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:46.538874918 +0000 UTC m=+130.245841214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs") pod "network-metrics-daemon-cns8m" (UID: "d6b04cb3-93e1-4110-a31b-88b4fd21a5b3") : secret "metrics-daemon-secret" not found Jun 02 01:11:42.629341 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.629316 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:42.632127 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.632111 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:11:42.642848 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.642831 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:11:42.653735 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.653707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmn4t\" (UniqueName: \"kubernetes.io/projected/8daa06c1-9a4c-4575-8115-f836c5bfa8ac-kube-api-access-bmn4t\") pod \"network-check-target-9glg4\" (UID: \"8daa06c1-9a4c-4575-8115-f836c5bfa8ac\") " pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:42.705779 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.705759 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dfq6c\"" Jun 02 01:11:42.713689 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.713673 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:42.849921 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:42.849890 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9glg4"] Jun 02 01:11:42.853362 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:11:42.853338 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daa06c1_9a4c_4575_8115_f836c5bfa8ac.slice/crio-68939b5400378f1057888e956b4257120ff1a759ec3110cd4ebd698901d98312 WatchSource:0}: Error finding container 68939b5400378f1057888e956b4257120ff1a759ec3110cd4ebd698901d98312: Status 404 returned error can't find the container with id 68939b5400378f1057888e956b4257120ff1a759ec3110cd4ebd698901d98312 Jun 02 01:11:43.113861 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:43.113784 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9glg4" event={"ID":"8daa06c1-9a4c-4575-8115-f836c5bfa8ac","Type":"ContainerStarted","Data":"68939b5400378f1057888e956b4257120ff1a759ec3110cd4ebd698901d98312"} Jun 02 01:11:48.123715 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:48.123681 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9glg4" event={"ID":"8daa06c1-9a4c-4575-8115-f836c5bfa8ac","Type":"ContainerStarted","Data":"a668b246fd10fd6a1debf34639deace5cc4844c196b4d802a2c77b327d798246"} Jun 02 01:11:48.124194 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:48.123806 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:11:48.142095 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:11:48.139685 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9glg4" podStartSLOduration=66.960855606 podStartE2EDuration="1m11.139668477s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:11:42.855166202 +0000 UTC m=+66.562132499" lastFinishedPulling="2026-06-02 01:11:47.033979067 +0000 UTC m=+70.740945370" observedRunningTime="2026-06-02 01:11:48.138529192 +0000 UTC m=+71.845495490" watchObservedRunningTime="2026-06-02 01:11:48.139668477 +0000 UTC m=+71.846634798" Jun 02 01:12:00.709822 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.709690 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d7749b7ff-7s8wm"] Jun 02 01:12:00.713707 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.713690 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.716055 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.716027 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 01:12:00.716170 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.716067 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l68pw\"" Jun 02 01:12:00.716170 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.716109 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 01:12:00.716279 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.716263 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 01:12:00.716345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.716329 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 01:12:00.717055 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.717042 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.717159 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.717137 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.721650 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.721628 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d7749b7ff-7s8wm"] Jun 02 01:12:00.814127 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.814102 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tl6jd"] Jun 02 01:12:00.816734 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.816719 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.819078 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.819060 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 02 01:12:00.819196 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.819157 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dw75q\"" Jun 02 01:12:00.819267 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.819208 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.819332 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.819292 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 02 01:12:00.819332 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.819313 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.824237 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.824219 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 02 01:12:00.826577 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.826560 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tl6jd"] Jun 02 01:12:00.865425 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.865405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.865522 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.865451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.865522 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.865478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-stats-auth\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.865647 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.865555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-default-certificate\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.865647 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.865580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkdb5\" (UniqueName: \"kubernetes.io/projected/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-kube-api-access-kkdb5\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.911603 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.911575 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7"] Jun 02 01:12:00.914300 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.914282 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" Jun 02 01:12:00.916905 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.916881 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 02 01:12:00.917019 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.916978 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-r7z6g\"" Jun 02 01:12:00.917181 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.917159 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:00.921443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.921415 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7"] Jun 02 01:12:00.966790 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxnmh\" (UniqueName: \"kubernetes.io/projected/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-kube-api-access-jxnmh\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.966790 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966758 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.966790 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.966955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-stats-auth\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.966955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-tmp\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.966955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-snapshots\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.966955 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:00.966914 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.46689414 +0000 UTC m=+85.173860456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:00.967195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.966983 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-default-certificate\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.967195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.967018 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-serving-cert\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.967195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.967042 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkdb5\" (UniqueName: \"kubernetes.io/projected/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-kube-api-access-kkdb5\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.967195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.967086 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.967195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.967146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-service-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:00.967380 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:00.967154 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:00.967380 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:00.967257 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:01.467237681 +0000 UTC m=+85.174203978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:00.969246 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.969218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-stats-auth\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.969335 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.969248 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-default-certificate\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:00.981426 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:00.981405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkdb5\" (UniqueName: \"kubernetes.io/projected/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-kube-api-access-kkdb5\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:01.068021 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.067991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-service-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068187 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068137 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxnmh\" (UniqueName: \"kubernetes.io/projected/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-kube-api-access-jxnmh\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068187 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068177 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068307 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw2cx\" (UniqueName: \"kubernetes.io/projected/c286172a-f562-41d9-9445-3bfebcb9e54e-kube-api-access-xw2cx\") pod \"volume-data-source-validator-7598fd5bd-7vjb7\" (UID: \"c286172a-f562-41d9-9445-3bfebcb9e54e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" Jun 02 01:12:01.068307 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-tmp\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068307 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068274 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-snapshots\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068431 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068358 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-serving-cert\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068607 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-service-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068802 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-tmp\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068872 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-snapshots\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.068910 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.068888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.070541 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.070517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-serving-cert\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.076981 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.076942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxnmh\" (UniqueName: \"kubernetes.io/projected/d1a16c67-2f9d-4f2d-82cd-44ce034776b0-kube-api-access-jxnmh\") pod \"insights-operator-788bf58df5-tl6jd\" (UID: \"d1a16c67-2f9d-4f2d-82cd-44ce034776b0\") " pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.125234 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.125208 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" Jun 02 01:12:01.170360 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.169673 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw2cx\" (UniqueName: \"kubernetes.io/projected/c286172a-f562-41d9-9445-3bfebcb9e54e-kube-api-access-xw2cx\") pod \"volume-data-source-validator-7598fd5bd-7vjb7\" (UID: \"c286172a-f562-41d9-9445-3bfebcb9e54e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" Jun 02 01:12:01.186123 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.185768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw2cx\" (UniqueName: \"kubernetes.io/projected/c286172a-f562-41d9-9445-3bfebcb9e54e-kube-api-access-xw2cx\") pod \"volume-data-source-validator-7598fd5bd-7vjb7\" (UID: \"c286172a-f562-41d9-9445-3bfebcb9e54e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" Jun 02 01:12:01.222573 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.222501 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" Jun 02 01:12:01.243558 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.243531 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-tl6jd"] Jun 02 01:12:01.246675 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:01.246650 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1a16c67_2f9d_4f2d_82cd_44ce034776b0.slice/crio-2677a033ff640f3fb1ea36f1ed67715a6453d0033d7de4c638f37c0768ac4d5a WatchSource:0}: Error finding container 2677a033ff640f3fb1ea36f1ed67715a6453d0033d7de4c638f37c0768ac4d5a: Status 404 returned error can't find the container with id 2677a033ff640f3fb1ea36f1ed67715a6453d0033d7de4c638f37c0768ac4d5a Jun 02 01:12:01.340729 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.339013 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7"] Jun 02 01:12:01.344502 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:01.344474 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc286172a_f562_41d9_9445_3bfebcb9e54e.slice/crio-6580c11a565226e72aad0782fdc93eb3574e9456dd9a8092adaa29ada5a2c3a0 WatchSource:0}: Error finding container 6580c11a565226e72aad0782fdc93eb3574e9456dd9a8092adaa29ada5a2c3a0: Status 404 returned error can't find the container with id 6580c11a565226e72aad0782fdc93eb3574e9456dd9a8092adaa29ada5a2c3a0 Jun 02 01:12:01.471688 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.471653 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:01.471847 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:01.471732 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:01.471847 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:01.471822 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:01.471928 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:01.471887 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.47186537 +0000 UTC m=+86.178831683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:01.471928 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:01.471905 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:02.471898558 +0000 UTC m=+86.178864854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:02.150722 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:02.150685 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" event={"ID":"c286172a-f562-41d9-9445-3bfebcb9e54e","Type":"ContainerStarted","Data":"6580c11a565226e72aad0782fdc93eb3574e9456dd9a8092adaa29ada5a2c3a0"} Jun 02 01:12:02.152027 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:02.151989 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" event={"ID":"d1a16c67-2f9d-4f2d-82cd-44ce034776b0","Type":"ContainerStarted","Data":"2677a033ff640f3fb1ea36f1ed67715a6453d0033d7de4c638f37c0768ac4d5a"} Jun 02 01:12:02.481229 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:02.481052 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:02.481229 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:02.481169 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:02.481229 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:02.481222 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:04.48120381 +0000 UTC m=+88.188170113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:02.481549 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:02.481302 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:02.481549 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:02.481368 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:04.481351505 +0000 UTC m=+88.188317815 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:04.157736 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.157699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" event={"ID":"c286172a-f562-41d9-9445-3bfebcb9e54e","Type":"ContainerStarted","Data":"134ed4715901e8f02551e75fab6dbd1fd9eeab79c1df71df51e13e9d91bfe53b"} Jun 02 01:12:04.158997 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.158950 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" event={"ID":"d1a16c67-2f9d-4f2d-82cd-44ce034776b0","Type":"ContainerStarted","Data":"5d205baf9bf53cf580fa8a6867ed88253418d02f5ed05dd748384200497a31d4"} Jun 02 01:12:04.175602 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.175556 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-7vjb7" podStartSLOduration=2.204691035 podStartE2EDuration="4.175543747s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="2026-06-02 01:12:01.346220972 +0000 UTC m=+85.053187269" lastFinishedPulling="2026-06-02 01:12:03.317073667 +0000 UTC m=+87.024039981" observedRunningTime="2026-06-02 01:12:04.173873206 +0000 UTC m=+87.880839525" watchObservedRunningTime="2026-06-02 01:12:04.175543747 +0000 UTC m=+87.882510066" Jun 02 01:12:04.497744 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.497666 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:04.497882 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.497820 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:04.497882 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:04.497840 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:08.497821191 +0000 UTC m=+92.204787491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:04.497955 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:04.497895 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:04.497955 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:04.497933 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:08.497922483 +0000 UTC m=+92.204888781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:04.754542 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.754446 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" podStartSLOduration=2.6862433770000003 podStartE2EDuration="4.754430075s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="2026-06-02 01:12:01.248482538 +0000 UTC m=+84.955448838" lastFinishedPulling="2026-06-02 01:12:03.316669236 +0000 UTC m=+87.023635536" observedRunningTime="2026-06-02 01:12:04.190742781 +0000 UTC m=+87.897709102" watchObservedRunningTime="2026-06-02 01:12:04.754430075 +0000 UTC m=+88.461396393" Jun 02 01:12:04.754719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.754706 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92"] Jun 02 01:12:04.757778 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.757763 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:04.760148 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.760123 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 02 01:12:04.760433 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.760419 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:04.760482 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.760417 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 02 01:12:04.761231 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.761215 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-cfddl\"" Jun 02 01:12:04.761308 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.761221 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 02 01:12:04.765749 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.765730 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92"] Jun 02 01:12:04.901356 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.901331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqb9\" (UniqueName: \"kubernetes.io/projected/5dd867a7-f801-421e-a366-dd3daf7e7402-kube-api-access-jnqb9\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:04.901487 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.901362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd867a7-f801-421e-a366-dd3daf7e7402-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:04.901487 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:04.901378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5dd867a7-f801-421e-a366-dd3daf7e7402-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.002661 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.002623 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqb9\" (UniqueName: \"kubernetes.io/projected/5dd867a7-f801-421e-a366-dd3daf7e7402-kube-api-access-jnqb9\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.002807 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.002672 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd867a7-f801-421e-a366-dd3daf7e7402-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.002807 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.002702 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5dd867a7-f801-421e-a366-dd3daf7e7402-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.003338 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.003320 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5dd867a7-f801-421e-a366-dd3daf7e7402-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.004789 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.004746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5dd867a7-f801-421e-a366-dd3daf7e7402-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.010544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.010517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqb9\" (UniqueName: \"kubernetes.io/projected/5dd867a7-f801-421e-a366-dd3daf7e7402-kube-api-access-jnqb9\") pod \"kube-storage-version-migrator-operator-96ddc787c-qfv92\" (UID: \"5dd867a7-f801-421e-a366-dd3daf7e7402\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.066484 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.066458 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" Jun 02 01:12:05.184113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:05.184084 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92"] Jun 02 01:12:05.188474 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:05.188448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd867a7_f801_421e_a366_dd3daf7e7402.slice/crio-c753e2c8d381e88608e94c6e7c70e53f4f52e1103375f8edcdb8b649bef3d59f WatchSource:0}: Error finding container c753e2c8d381e88608e94c6e7c70e53f4f52e1103375f8edcdb8b649bef3d59f: Status 404 returned error can't find the container with id c753e2c8d381e88608e94c6e7c70e53f4f52e1103375f8edcdb8b649bef3d59f Jun 02 01:12:06.164746 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.164702 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" event={"ID":"5dd867a7-f801-421e-a366-dd3daf7e7402","Type":"ContainerStarted","Data":"c753e2c8d381e88608e94c6e7c70e53f4f52e1103375f8edcdb8b649bef3d59f"} Jun 02 01:12:06.244797 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.244768 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h987k_89f2be46-581c-4926-8631-dbff6e479f27/dns-node-resolver/0.log" Jun 02 01:12:06.797155 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.797128 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn"] Jun 02 01:12:06.800389 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.800370 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:06.802645 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.802622 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 02 01:12:06.802748 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.802673 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:06.802819 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.802758 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h658d\"" Jun 02 01:12:06.802908 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.802890 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 02 01:12:06.803060 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.802958 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 02 01:12:06.808406 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.807612 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn"] Jun 02 01:12:06.919348 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.919315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd533305-f7c5-4c5b-a020-53787c2314f2-config\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:06.919542 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.919390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hvgf\" (UniqueName: \"kubernetes.io/projected/cd533305-f7c5-4c5b-a020-53787c2314f2-kube-api-access-6hvgf\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:06.919542 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:06.919506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd533305-f7c5-4c5b-a020-53787c2314f2-serving-cert\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.020608 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.020581 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd533305-f7c5-4c5b-a020-53787c2314f2-config\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.020774 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.020646 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hvgf\" (UniqueName: \"kubernetes.io/projected/cd533305-f7c5-4c5b-a020-53787c2314f2-kube-api-access-6hvgf\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.020774 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.020702 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd533305-f7c5-4c5b-a020-53787c2314f2-serving-cert\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.021218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.021188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd533305-f7c5-4c5b-a020-53787c2314f2-config\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.023231 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.023208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd533305-f7c5-4c5b-a020-53787c2314f2-serving-cert\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.031070 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.031037 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hvgf\" (UniqueName: \"kubernetes.io/projected/cd533305-f7c5-4c5b-a020-53787c2314f2-kube-api-access-6hvgf\") pod \"service-ca-operator-69877444c-kmnmn\" (UID: \"cd533305-f7c5-4c5b-a020-53787c2314f2\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.111419 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.111339 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" Jun 02 01:12:07.121190 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.121159 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9"] Jun 02 01:12:07.124440 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.124413 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" Jun 02 01:12:07.126954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.126931 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bsf7f\"" Jun 02 01:12:07.133679 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.133660 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9"] Jun 02 01:12:07.222589 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.222562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bwbj\" (UniqueName: \"kubernetes.io/projected/aa2cea85-4394-4d37-a875-97b5471d384f-kube-api-access-4bwbj\") pod \"network-check-source-56d84b9f44-7gkt9\" (UID: \"aa2cea85-4394-4d37-a875-97b5471d384f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" Jun 02 01:12:07.245060 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.245038 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2wmnp_8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce/node-ca/0.log" Jun 02 01:12:07.280452 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.280429 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn"] Jun 02 01:12:07.283722 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:07.283690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd533305_f7c5_4c5b_a020_53787c2314f2.slice/crio-1e0dc14c4a09441c7f58ba516d38b0629138a15c2adc793af3cae9b1f2b8c623 WatchSource:0}: Error finding container 1e0dc14c4a09441c7f58ba516d38b0629138a15c2adc793af3cae9b1f2b8c623: Status 404 returned error can't find the container with id 1e0dc14c4a09441c7f58ba516d38b0629138a15c2adc793af3cae9b1f2b8c623 Jun 02 01:12:07.323098 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.323074 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4bwbj\" (UniqueName: \"kubernetes.io/projected/aa2cea85-4394-4d37-a875-97b5471d384f-kube-api-access-4bwbj\") pod \"network-check-source-56d84b9f44-7gkt9\" (UID: \"aa2cea85-4394-4d37-a875-97b5471d384f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" Jun 02 01:12:07.331134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.331105 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bwbj\" (UniqueName: \"kubernetes.io/projected/aa2cea85-4394-4d37-a875-97b5471d384f-kube-api-access-4bwbj\") pod \"network-check-source-56d84b9f44-7gkt9\" (UID: \"aa2cea85-4394-4d37-a875-97b5471d384f\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" Jun 02 01:12:07.436302 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.436229 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" Jun 02 01:12:07.550223 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:07.550191 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9"] Jun 02 01:12:07.553544 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:07.553515 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa2cea85_4394_4d37_a875_97b5471d384f.slice/crio-ddcaf4a15ea2d9559e2b7152604ffc69f9c10f09a8a53581e8588c8c155ded7a WatchSource:0}: Error finding container ddcaf4a15ea2d9559e2b7152604ffc69f9c10f09a8a53581e8588c8c155ded7a: Status 404 returned error can't find the container with id ddcaf4a15ea2d9559e2b7152604ffc69f9c10f09a8a53581e8588c8c155ded7a Jun 02 01:12:08.170880 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.170832 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" event={"ID":"cd533305-f7c5-4c5b-a020-53787c2314f2","Type":"ContainerStarted","Data":"1e0dc14c4a09441c7f58ba516d38b0629138a15c2adc793af3cae9b1f2b8c623"} Jun 02 01:12:08.172337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.172304 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" event={"ID":"aa2cea85-4394-4d37-a875-97b5471d384f","Type":"ContainerStarted","Data":"93d4aa667ff7727c4584ced929754c4677ee00e32ff0b6cbff3aa9b16c82f48a"} Jun 02 01:12:08.172484 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.172340 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" event={"ID":"aa2cea85-4394-4d37-a875-97b5471d384f","Type":"ContainerStarted","Data":"ddcaf4a15ea2d9559e2b7152604ffc69f9c10f09a8a53581e8588c8c155ded7a"} Jun 02 01:12:08.173824 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.173794 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" event={"ID":"5dd867a7-f801-421e-a366-dd3daf7e7402","Type":"ContainerStarted","Data":"f8f833a3e42245a2249af016363313f87e082fb9df4d107ed2e694831848bf03"} Jun 02 01:12:08.192166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.192083 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-7gkt9" podStartSLOduration=1.192067535 podStartE2EDuration="1.192067535s" podCreationTimestamp="2026-06-02 01:12:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:12:08.191539949 +0000 UTC m=+91.898506271" watchObservedRunningTime="2026-06-02 01:12:08.192067535 +0000 UTC m=+91.899033856" Jun 02 01:12:08.207697 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.207653 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" podStartSLOduration=2.187964967 podStartE2EDuration="4.207638096s" podCreationTimestamp="2026-06-02 01:12:04 +0000 UTC" firstStartedPulling="2026-06-02 01:12:05.19040946 +0000 UTC m=+88.897375757" lastFinishedPulling="2026-06-02 01:12:07.210082576 +0000 UTC m=+90.917048886" observedRunningTime="2026-06-02 01:12:08.206915832 +0000 UTC m=+91.913882176" watchObservedRunningTime="2026-06-02 01:12:08.207638096 +0000 UTC m=+91.914604609" Jun 02 01:12:08.535459 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.535421 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:08.535875 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.535473 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:08.535875 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:08.535594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:16.535574622 +0000 UTC m=+100.242540930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:08.535875 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:08.535617 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:08.535875 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:08.535653 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:16.535642668 +0000 UTC m=+100.242608970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:08.821996 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.821906 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt"] Jun 02 01:12:08.825174 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.825148 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" Jun 02 01:12:08.827890 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.827869 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 01:12:08.828031 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.827895 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 01:12:08.828465 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.828449 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9z7rp\"" Jun 02 01:12:08.832457 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.832381 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt"] Jun 02 01:12:08.938661 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:08.938618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s69mw\" (UniqueName: \"kubernetes.io/projected/f28c6a75-7eda-4ec3-89db-28d488ee9641-kube-api-access-s69mw\") pod \"migrator-96c6f749-t8brt\" (UID: \"f28c6a75-7eda-4ec3-89db-28d488ee9641\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" Jun 02 01:12:09.039147 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:09.039108 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s69mw\" (UniqueName: \"kubernetes.io/projected/f28c6a75-7eda-4ec3-89db-28d488ee9641-kube-api-access-s69mw\") pod \"migrator-96c6f749-t8brt\" (UID: \"f28c6a75-7eda-4ec3-89db-28d488ee9641\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" Jun 02 01:12:09.048031 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:09.048004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s69mw\" (UniqueName: \"kubernetes.io/projected/f28c6a75-7eda-4ec3-89db-28d488ee9641-kube-api-access-s69mw\") pod \"migrator-96c6f749-t8brt\" (UID: \"f28c6a75-7eda-4ec3-89db-28d488ee9641\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" Jun 02 01:12:09.135276 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:09.135196 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" Jun 02 01:12:09.611020 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:09.610993 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt"] Jun 02 01:12:09.614495 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:09.614467 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28c6a75_7eda_4ec3_89db_28d488ee9641.slice/crio-9903b1e0671af42a000e1971839f4328de1982574346952705f0dddf1890656c WatchSource:0}: Error finding container 9903b1e0671af42a000e1971839f4328de1982574346952705f0dddf1890656c: Status 404 returned error can't find the container with id 9903b1e0671af42a000e1971839f4328de1982574346952705f0dddf1890656c Jun 02 01:12:10.178951 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:10.178919 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" event={"ID":"f28c6a75-7eda-4ec3-89db-28d488ee9641","Type":"ContainerStarted","Data":"9903b1e0671af42a000e1971839f4328de1982574346952705f0dddf1890656c"} Jun 02 01:12:10.180117 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:10.180092 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" event={"ID":"cd533305-f7c5-4c5b-a020-53787c2314f2","Type":"ContainerStarted","Data":"a84c0abe1247204d5346403b2c556c6ebec430ae8adbad05b08631fd30f711d0"} Jun 02 01:12:10.195308 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:10.195265 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" podStartSLOduration=1.939116338 podStartE2EDuration="4.19525168s" podCreationTimestamp="2026-06-02 01:12:06 +0000 UTC" firstStartedPulling="2026-06-02 01:12:07.285660564 +0000 UTC m=+90.992626864" lastFinishedPulling="2026-06-02 01:12:09.541795895 +0000 UTC m=+93.248762206" observedRunningTime="2026-06-02 01:12:10.193927034 +0000 UTC m=+93.900893354" watchObservedRunningTime="2026-06-02 01:12:10.19525168 +0000 UTC m=+93.902217998" Jun 02 01:12:11.183893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:11.183856 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" event={"ID":"f28c6a75-7eda-4ec3-89db-28d488ee9641","Type":"ContainerStarted","Data":"dd5d7688ad690c53f71bd597a767bded42455f73c56c1be1e8dd57c905f4c49d"} Jun 02 01:12:11.183893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:11.183895 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" event={"ID":"f28c6a75-7eda-4ec3-89db-28d488ee9641","Type":"ContainerStarted","Data":"fc5592f7529fc76d43d8bf39e4a9242452599a78f155d8afd35160e178bf6ea1"} Jun 02 01:12:11.207610 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:11.207564 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-t8brt" podStartSLOduration=2.134287463 podStartE2EDuration="3.207551868s" podCreationTimestamp="2026-06-02 01:12:08 +0000 UTC" firstStartedPulling="2026-06-02 01:12:09.616569495 +0000 UTC m=+93.323535796" lastFinishedPulling="2026-06-02 01:12:10.689833891 +0000 UTC m=+94.396800201" observedRunningTime="2026-06-02 01:12:11.206323421 +0000 UTC m=+94.913289738" watchObservedRunningTime="2026-06-02 01:12:11.207551868 +0000 UTC m=+94.914518187" Jun 02 01:12:14.183190 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:14.183138 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") pod \"image-registry-7b4c4fdc8-wtwrq\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:14.183228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.183285 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.183303 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7b4c4fdc8-wtwrq: secret "image-registry-tls" not found Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.183328 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.183357 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls podName:c7bb0393-b4d4-499d-bd45-a82561632f71 nodeName:}" failed. No retries permitted until 2026-06-02 01:13:18.183341583 +0000 UTC m=+161.890307881 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls") pod "image-registry-7b4c4fdc8-wtwrq" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71") : secret "image-registry-tls" not found Jun 02 01:12:14.183558 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.183373 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert podName:68b1b821-9cfd-44c0-82d7-71129551079f nodeName:}" failed. No retries permitted until 2026-06-02 01:13:18.183366795 +0000 UTC m=+161.890333091 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert") pod "ingress-canary-98ph6" (UID: "68b1b821-9cfd-44c0-82d7-71129551079f") : secret "canary-serving-cert" not found Jun 02 01:12:14.283804 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:14.283769 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:12:14.283988 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.283876 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:12:14.283988 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:14.283926 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls podName:990d3632-d0a1-43f5-8d8c-d0149df6d297 nodeName:}" failed. No retries permitted until 2026-06-02 01:13:18.283913397 +0000 UTC m=+161.990879694 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls") pod "dns-default-8q6qf" (UID: "990d3632-d0a1-43f5-8d8c-d0149df6d297") : secret "dns-default-metrics-tls" not found Jun 02 01:12:16.604934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:16.604901 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:16.605339 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:16.604950 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:16.605339 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:16.605109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:32.605079481 +0000 UTC m=+116.312045785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : configmap references non-existent config key: service-ca.crt Jun 02 01:12:16.605339 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:16.605124 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 01:12:16.605339 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:16.605169 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs podName:421b0cdb-3d99-4aa2-ac7c-2b192cf0936e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:32.605156656 +0000 UTC m=+116.312122954 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs") pod "router-default-6d7749b7ff-7s8wm" (UID: "421b0cdb-3d99-4aa2-ac7c-2b192cf0936e") : secret "router-metrics-certs-default" not found Jun 02 01:12:19.128248 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:19.128215 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9glg4" Jun 02 01:12:32.632386 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.632333 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:32.632886 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.632458 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:32.632980 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.632945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-service-ca-bundle\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:32.634664 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.634645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/421b0cdb-3d99-4aa2-ac7c-2b192cf0936e-metrics-certs\") pod \"router-default-6d7749b7ff-7s8wm\" (UID: \"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e\") " pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:32.823472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.823441 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:32.910095 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.910063 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb"] Jun 02 01:12:32.916494 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.916469 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:32.919020 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.918995 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 01:12:32.920544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.919985 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xmht7\"" Jun 02 01:12:32.920544 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.919986 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 01:12:32.922875 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.922854 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb"] Jun 02 01:12:32.935453 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.935430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:32.936121 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.935488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:32.952099 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:32.952077 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d7749b7ff-7s8wm"] Jun 02 01:12:32.954335 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:32.954302 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421b0cdb_3d99_4aa2_ac7c_2b192cf0936e.slice/crio-07f909430c2344947800f5d295c0e0aa3b89a64539cc9f2eb14e618de2dec69a WatchSource:0}: Error finding container 07f909430c2344947800f5d295c0e0aa3b89a64539cc9f2eb14e618de2dec69a: Status 404 returned error can't find the container with id 07f909430c2344947800f5d295c0e0aa3b89a64539cc9f2eb14e618de2dec69a Jun 02 01:12:33.018208 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.018182 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-bbcj5"] Jun 02 01:12:33.023343 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.023318 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:33.025927 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.025903 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 01:12:33.026084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.025984 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 01:12:33.026084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.026078 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mvrg5\"" Jun 02 01:12:33.033194 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.033160 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7x5mq"] Jun 02 01:12:33.036912 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.036253 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:33.036912 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.036310 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:33.037362 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.037316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:33.040574 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.040556 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-bbcj5"] Jun 02 01:12:33.040850 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.040832 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.041047 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.041026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-nwhlb\" (UID: \"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:33.043928 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.043746 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:12:33.043928 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.043815 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cfzm\"" Jun 02 01:12:33.043928 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.043870 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:12:33.048113 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.047898 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7x5mq"] Jun 02 01:12:33.137035 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93554440-39c5-4cc1-a592-342d3e0298ec-data-volume\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.137175 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93554440-39c5-4cc1-a592-342d3e0298ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.137175 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9746n\" (UniqueName: \"kubernetes.io/projected/93554440-39c5-4cc1-a592-342d3e0298ec-kube-api-access-9746n\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.137254 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137201 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93554440-39c5-4cc1-a592-342d3e0298ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.137307 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93554440-39c5-4cc1-a592-342d3e0298ec-crio-socket\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.137342 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.137334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4kd\" (UniqueName: \"kubernetes.io/projected/3a68fc1c-dd93-48e8-9793-46d994db41c6-kube-api-access-fz4kd\") pod \"downloads-c65b8dc4b-bbcj5\" (UID: \"3a68fc1c-dd93-48e8-9793-46d994db41c6\") " pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:33.228892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.228822 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" Jun 02 01:12:33.239690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239451 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93554440-39c5-4cc1-a592-342d3e0298ec-data-volume\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239508 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93554440-39c5-4cc1-a592-342d3e0298ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239551 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9746n\" (UniqueName: \"kubernetes.io/projected/93554440-39c5-4cc1-a592-342d3e0298ec-kube-api-access-9746n\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93554440-39c5-4cc1-a592-342d3e0298ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239690 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239659 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93554440-39c5-4cc1-a592-342d3e0298ec-crio-socket\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239951 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239712 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4kd\" (UniqueName: \"kubernetes.io/projected/3a68fc1c-dd93-48e8-9793-46d994db41c6-kube-api-access-fz4kd\") pod \"downloads-c65b8dc4b-bbcj5\" (UID: \"3a68fc1c-dd93-48e8-9793-46d994db41c6\") " pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:33.239951 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/93554440-39c5-4cc1-a592-342d3e0298ec-data-volume\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.239951 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.239881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/93554440-39c5-4cc1-a592-342d3e0298ec-crio-socket\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.240687 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.240663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/93554440-39c5-4cc1-a592-342d3e0298ec-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.241393 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.241360 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" event={"ID":"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e","Type":"ContainerStarted","Data":"4350223f6b4796913a5c5e9ca61f857b1d019bb3e2582d1ccfcf987b1586ff37"} Jun 02 01:12:33.241482 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.241402 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" event={"ID":"421b0cdb-3d99-4aa2-ac7c-2b192cf0936e","Type":"ContainerStarted","Data":"07f909430c2344947800f5d295c0e0aa3b89a64539cc9f2eb14e618de2dec69a"} Jun 02 01:12:33.242166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.242150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/93554440-39c5-4cc1-a592-342d3e0298ec-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.248804 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.248783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4kd\" (UniqueName: \"kubernetes.io/projected/3a68fc1c-dd93-48e8-9793-46d994db41c6-kube-api-access-fz4kd\") pod \"downloads-c65b8dc4b-bbcj5\" (UID: \"3a68fc1c-dd93-48e8-9793-46d994db41c6\") " pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:33.249326 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.249305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9746n\" (UniqueName: \"kubernetes.io/projected/93554440-39c5-4cc1-a592-342d3e0298ec-kube-api-access-9746n\") pod \"insights-runtime-extractor-7x5mq\" (UID: \"93554440-39c5-4cc1-a592-342d3e0298ec\") " pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.263040 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.262995 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" podStartSLOduration=33.262981314 podStartE2EDuration="33.262981314s" podCreationTimestamp="2026-06-02 01:12:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:12:33.26226176 +0000 UTC m=+116.969228101" watchObservedRunningTime="2026-06-02 01:12:33.262981314 +0000 UTC m=+116.969947632" Jun 02 01:12:33.334228 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.334198 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:33.351098 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.351069 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7x5mq" Jun 02 01:12:33.351618 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.351591 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb"] Jun 02 01:12:33.356275 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:33.356248 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cf2ffb3_f0f0_4805_9c8c_cf6d9ec507af.slice/crio-88f3f5d6934c56435adc90ae679a21d5dbbc498cf39e6e50e58e546e610999cc WatchSource:0}: Error finding container 88f3f5d6934c56435adc90ae679a21d5dbbc498cf39e6e50e58e546e610999cc: Status 404 returned error can't find the container with id 88f3f5d6934c56435adc90ae679a21d5dbbc498cf39e6e50e58e546e610999cc Jun 02 01:12:33.487562 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.487487 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-bbcj5"] Jun 02 01:12:33.490756 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:33.490720 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a68fc1c_dd93_48e8_9793_46d994db41c6.slice/crio-58e4a1ec7cd195ef4a8361186c3691738c1386f5563df4430b648ae94229edc4 WatchSource:0}: Error finding container 58e4a1ec7cd195ef4a8361186c3691738c1386f5563df4430b648ae94229edc4: Status 404 returned error can't find the container with id 58e4a1ec7cd195ef4a8361186c3691738c1386f5563df4430b648ae94229edc4 Jun 02 01:12:33.525242 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.525142 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7x5mq"] Jun 02 01:12:33.527461 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:33.527438 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93554440_39c5_4cc1_a592_342d3e0298ec.slice/crio-0b84b51c1a52306c44e8b22b83a326c0b7584824d3396f17596a91812727beb3 WatchSource:0}: Error finding container 0b84b51c1a52306c44e8b22b83a326c0b7584824d3396f17596a91812727beb3: Status 404 returned error can't find the container with id 0b84b51c1a52306c44e8b22b83a326c0b7584824d3396f17596a91812727beb3 Jun 02 01:12:33.824532 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.824497 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:33.827355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:33.827329 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:34.246279 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.246200 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-bbcj5" event={"ID":"3a68fc1c-dd93-48e8-9793-46d994db41c6","Type":"ContainerStarted","Data":"58e4a1ec7cd195ef4a8361186c3691738c1386f5563df4430b648ae94229edc4"} Jun 02 01:12:34.247878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.247841 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x5mq" event={"ID":"93554440-39c5-4cc1-a592-342d3e0298ec","Type":"ContainerStarted","Data":"277d2660eff42a9eac25fef32e9bcd32a8e136a5a9f2848e3885f83b06c38ba2"} Jun 02 01:12:34.248027 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.247884 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x5mq" event={"ID":"93554440-39c5-4cc1-a592-342d3e0298ec","Type":"ContainerStarted","Data":"0b84b51c1a52306c44e8b22b83a326c0b7584824d3396f17596a91812727beb3"} Jun 02 01:12:34.249155 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.249111 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" event={"ID":"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af","Type":"ContainerStarted","Data":"88f3f5d6934c56435adc90ae679a21d5dbbc498cf39e6e50e58e546e610999cc"} Jun 02 01:12:34.249414 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.249392 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:34.250772 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:34.250752 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d7749b7ff-7s8wm" Jun 02 01:12:35.257270 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:35.257229 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x5mq" event={"ID":"93554440-39c5-4cc1-a592-342d3e0298ec","Type":"ContainerStarted","Data":"ec8deaf0892c3f170193ef135aa40f6ff0d3a64c494685e2afd6177e88b1403e"} Jun 02 01:12:35.259606 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:35.259576 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" event={"ID":"3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af","Type":"ContainerStarted","Data":"6ecaafc2bcbe1b50e0c825a79b01365732aa3713c2dbe954088615719c057af8"} Jun 02 01:12:35.274266 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:35.274216 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-nwhlb" podStartSLOduration=2.143862988 podStartE2EDuration="3.274199418s" podCreationTimestamp="2026-06-02 01:12:32 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.358270953 +0000 UTC m=+117.065237250" lastFinishedPulling="2026-06-02 01:12:34.488607371 +0000 UTC m=+118.195573680" observedRunningTime="2026-06-02 01:12:35.273400221 +0000 UTC m=+118.980366542" watchObservedRunningTime="2026-06-02 01:12:35.274199418 +0000 UTC m=+118.981165738" Jun 02 01:12:36.264809 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:36.264713 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7x5mq" event={"ID":"93554440-39c5-4cc1-a592-342d3e0298ec","Type":"ContainerStarted","Data":"e845592347eb4e4d79585574d02e795d3fd4633211d4a9cddfd0fefc014ce7ac"} Jun 02 01:12:36.280945 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:36.280772 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7x5mq" podStartSLOduration=0.917992955 podStartE2EDuration="3.280755161s" podCreationTimestamp="2026-06-02 01:12:33 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.581028401 +0000 UTC m=+117.287994698" lastFinishedPulling="2026-06-02 01:12:35.943790596 +0000 UTC m=+119.650756904" observedRunningTime="2026-06-02 01:12:36.280638339 +0000 UTC m=+119.987604659" watchObservedRunningTime="2026-06-02 01:12:36.280755161 +0000 UTC m=+119.987721478" Jun 02 01:12:40.785443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.785404 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs"] Jun 02 01:12:40.791107 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.791087 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:40.793796 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.793730 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:12:40.793899 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.793871 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:12:40.796998 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.796954 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jxtvz\"" Jun 02 01:12:40.799077 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.798857 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:12:40.801931 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.799847 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 01:12:40.801931 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.800480 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 01:12:40.805751 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.805731 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs"] Jun 02 01:12:40.907013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.906958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74vh4\" (UniqueName: \"kubernetes.io/projected/068e3390-2fb0-4321-ac49-ecbe20948a39-kube-api-access-74vh4\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:40.907186 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.907155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:40.907283 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.907260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/068e3390-2fb0-4321-ac49-ecbe20948a39-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:40.907326 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:40.907300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.008181 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.008130 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.008364 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.008198 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/068e3390-2fb0-4321-ac49-ecbe20948a39-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.008364 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.008228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.008364 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.008289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74vh4\" (UniqueName: \"kubernetes.io/projected/068e3390-2fb0-4321-ac49-ecbe20948a39-kube-api-access-74vh4\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.008847 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.008824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/068e3390-2fb0-4321-ac49-ecbe20948a39-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.010623 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.010599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.010723 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.010701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/068e3390-2fb0-4321-ac49-ecbe20948a39-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.018754 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.018727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74vh4\" (UniqueName: \"kubernetes.io/projected/068e3390-2fb0-4321-ac49-ecbe20948a39-kube-api-access-74vh4\") pod \"prometheus-operator-658bcd8bdf-hslcs\" (UID: \"068e3390-2fb0-4321-ac49-ecbe20948a39\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.106195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.106121 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" Jun 02 01:12:41.244223 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.244190 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs"] Jun 02 01:12:41.246943 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:41.246912 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068e3390_2fb0_4321_ac49_ecbe20948a39.slice/crio-b0b2fcb5c51df79a412f8638e9a7a83b052753a58ba3103fa511728b731376d9 WatchSource:0}: Error finding container b0b2fcb5c51df79a412f8638e9a7a83b052753a58ba3103fa511728b731376d9: Status 404 returned error can't find the container with id b0b2fcb5c51df79a412f8638e9a7a83b052753a58ba3103fa511728b731376d9 Jun 02 01:12:41.279844 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:41.279798 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" event={"ID":"068e3390-2fb0-4321-ac49-ecbe20948a39","Type":"ContainerStarted","Data":"b0b2fcb5c51df79a412f8638e9a7a83b052753a58ba3103fa511728b731376d9"} Jun 02 01:12:43.286803 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:43.286767 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" event={"ID":"068e3390-2fb0-4321-ac49-ecbe20948a39","Type":"ContainerStarted","Data":"5efb5dd6a8f63e75a95070f69cd395376d17afbddd7856d4bd88caa2dd10c065"} Jun 02 01:12:43.286803 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:43.286806 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" event={"ID":"068e3390-2fb0-4321-ac49-ecbe20948a39","Type":"ContainerStarted","Data":"5b4ad9491ee58258c35677bd4b3a9eeb48e0d299b26d1fb389fb2e0c76b3334b"} Jun 02 01:12:43.302762 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:43.302717 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-hslcs" podStartSLOduration=1.962491055 podStartE2EDuration="3.302703292s" podCreationTimestamp="2026-06-02 01:12:40 +0000 UTC" firstStartedPulling="2026-06-02 01:12:41.249028258 +0000 UTC m=+124.955994558" lastFinishedPulling="2026-06-02 01:12:42.589240487 +0000 UTC m=+126.296206795" observedRunningTime="2026-06-02 01:12:43.302111065 +0000 UTC m=+127.009077385" watchObservedRunningTime="2026-06-02 01:12:43.302703292 +0000 UTC m=+127.009669611" Jun 02 01:12:45.134676 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.134639 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj"] Jun 02 01:12:45.140252 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.140228 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6zjcq"] Jun 02 01:12:45.140411 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.140392 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.143009 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.142986 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 02 01:12:45.143119 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.143082 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 02 01:12:45.143435 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.143301 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 02 01:12:45.143435 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.143339 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7j8z5\"" Jun 02 01:12:45.144076 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.144059 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.146072 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.146053 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:12:45.146338 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.146316 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:12:45.146531 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.146510 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:12:45.146666 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.146554 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mpn8j\"" Jun 02 01:12:45.150083 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.150064 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj"] Jun 02 01:12:45.245213 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-metrics-client-ca\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.245213 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrhf\" (UniqueName: \"kubernetes.io/projected/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-kube-api-access-ldrhf\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.245467 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-wtmp\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.245467 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.245907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246011 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.245954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-textfile\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246076 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246027 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.246076 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246060 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-root\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246174 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.246174 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246243 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d57fb365-0ee9-427f-986b-75c25cdeb227-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.246243 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.246349 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-sys\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246349 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.246446 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.246378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fhcx\" (UniqueName: \"kubernetes.io/projected/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-api-access-2fhcx\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.347632 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347582 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-sys\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.347632 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347623 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347652 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fhcx\" (UniqueName: \"kubernetes.io/projected/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-api-access-2fhcx\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347706 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-metrics-client-ca\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347732 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrhf\" (UniqueName: \"kubernetes.io/projected/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-kube-api-access-ldrhf\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-sys\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:45.347757 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:45.347816 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls podName:4248a1e7-9d7b-4b79-a868-fb9c24388fc1 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:45.847796434 +0000 UTC m=+129.554762739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls") pod "node-exporter-6zjcq" (UID: "4248a1e7-9d7b-4b79-a868-fb9c24388fc1") : secret "node-exporter-tls" not found Jun 02 01:12:45.347871 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347835 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-wtmp\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347891 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347925 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.347981 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-textfile\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348011 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348023 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-wtmp\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-root\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:45.348059 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348068 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:45.348125 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls podName:d57fb365-0ee9-427f-986b-75c25cdeb227 nodeName:}" failed. No retries permitted until 2026-06-02 01:12:45.848106926 +0000 UTC m=+129.555073239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-xk5qj" (UID: "d57fb365-0ee9-427f-986b-75c25cdeb227") : secret "kube-state-metrics-tls" not found Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348150 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348206 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d57fb365-0ee9-427f-986b-75c25cdeb227-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348237 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-metrics-client-ca\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-textfile\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-root\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348547 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-accelerators-collector-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d57fb365-0ee9-427f-986b-75c25cdeb227-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.348917 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.348889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57fb365-0ee9-427f-986b-75c25cdeb227-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.351009 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.350989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.351127 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.351048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.359825 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.359796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrhf\" (UniqueName: \"kubernetes.io/projected/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-kube-api-access-ldrhf\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.364424 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.364090 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fhcx\" (UniqueName: \"kubernetes.io/projected/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-api-access-2fhcx\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.852612 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.852574 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.852784 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.852679 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:45.855140 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.855114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4248a1e7-9d7b-4b79-a868-fb9c24388fc1-node-exporter-tls\") pod \"node-exporter-6zjcq\" (UID: \"4248a1e7-9d7b-4b79-a868-fb9c24388fc1\") " pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:45.855253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:45.855201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d57fb365-0ee9-427f-986b-75c25cdeb227-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-xk5qj\" (UID: \"d57fb365-0ee9-427f-986b-75c25cdeb227\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:46.053255 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.053221 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" Jun 02 01:12:46.060110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.060085 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6zjcq" Jun 02 01:12:46.559758 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.559718 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:12:46.562291 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.562269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6b04cb3-93e1-4110-a31b-88b4fd21a5b3-metrics-certs\") pod \"network-metrics-daemon-cns8m\" (UID: \"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3\") " pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:12:46.806902 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.806872 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r5956\"" Jun 02 01:12:46.814730 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:46.814658 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cns8m" Jun 02 01:12:51.324672 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.324638 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 01:12:51.329049 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.329019 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.331602 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.331576 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 01:12:51.332031 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.331979 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6dxlc\"" Jun 02 01:12:51.333010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.332757 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1h9rs5mu4qifq\"" Jun 02 01:12:51.333010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.332813 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 01:12:51.333010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.332864 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 01:12:51.333010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.332904 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 01:12:51.335455 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.333533 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 01:12:51.335455 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.333728 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 01:12:51.335455 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335099 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 01:12:51.335742 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335510 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 01:12:51.335742 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335525 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 01:12:51.335742 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335547 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 01:12:51.335742 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335673 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 01:12:51.335926 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.335772 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 01:12:51.336445 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.336405 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 01:12:51.340511 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.340134 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 01:12:51.400459 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400424 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dll\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-kube-api-access-x7dll\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400459 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.400756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-web-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.400936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.401000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.401021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config-out\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401085 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.401043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.401396 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.401101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502597 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502478 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dll\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-kube-api-access-x7dll\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502775 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502654 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502775 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502716 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502775 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502754 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502777 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502842 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502874 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.502934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.502918 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503322 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503393 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503460 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-web-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503506 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503544 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503575 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config-out\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503614 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503646 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.503843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.505008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.505871 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506826 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.506388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.506826 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.506789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.507137 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.507114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.507816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.507793 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.507948 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.507932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.508083 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.507994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.508316 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.508292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.508743 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.508702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.510204 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.510177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-config-out\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.510303 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.510281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.510667 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.510620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.510766 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.510663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-web-config\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.511075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.511029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dll\" (UniqueName: \"kubernetes.io/projected/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-kube-api-access-x7dll\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.511294 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.511275 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.643362 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.643249 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:12:51.698081 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:51.698046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4248a1e7_9d7b_4b79_a868_fb9c24388fc1.slice/crio-467b4ac50ecf8879ebe4bcfd9dfd665cfdae855bdb5ee30bb00b3eba92e8c111 WatchSource:0}: Error finding container 467b4ac50ecf8879ebe4bcfd9dfd665cfdae855bdb5ee30bb00b3eba92e8c111: Status 404 returned error can't find the container with id 467b4ac50ecf8879ebe4bcfd9dfd665cfdae855bdb5ee30bb00b3eba92e8c111 Jun 02 01:12:51.867161 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.867128 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 01:12:51.871201 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:51.871172 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168a02b3_9ad9_4d1e_80ed_994b6d3dc97e.slice/crio-af2817c88c2586d99a8102315eff179d9f6452f3129a4fc17316d586063d3048 WatchSource:0}: Error finding container af2817c88c2586d99a8102315eff179d9f6452f3129a4fc17316d586063d3048: Status 404 returned error can't find the container with id af2817c88c2586d99a8102315eff179d9f6452f3129a4fc17316d586063d3048 Jun 02 01:12:51.878878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.878852 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cns8m"] Jun 02 01:12:51.880805 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:51.880779 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b04cb3_93e1_4110_a31b_88b4fd21a5b3.slice/crio-f25fcdf2d788b9192b2247919393cbb6f786bb0a7d102eb7405486c81747376e WatchSource:0}: Error finding container f25fcdf2d788b9192b2247919393cbb6f786bb0a7d102eb7405486c81747376e: Status 404 returned error can't find the container with id f25fcdf2d788b9192b2247919393cbb6f786bb0a7d102eb7405486c81747376e Jun 02 01:12:51.894355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:51.894285 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj"] Jun 02 01:12:51.896715 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:12:51.896678 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd57fb365_0ee9_427f_986b_75c25cdeb227.slice/crio-c2ece2d296150de3f6244c4e031dd86b37e735b9b7987c0cb31220ff2fbfd8b3 WatchSource:0}: Error finding container c2ece2d296150de3f6244c4e031dd86b37e735b9b7987c0cb31220ff2fbfd8b3: Status 404 returned error can't find the container with id c2ece2d296150de3f6244c4e031dd86b37e735b9b7987c0cb31220ff2fbfd8b3 Jun 02 01:12:52.316914 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.316848 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjcq" event={"ID":"4248a1e7-9d7b-4b79-a868-fb9c24388fc1","Type":"ContainerStarted","Data":"467b4ac50ecf8879ebe4bcfd9dfd665cfdae855bdb5ee30bb00b3eba92e8c111"} Jun 02 01:12:52.318863 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.318800 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cns8m" event={"ID":"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3","Type":"ContainerStarted","Data":"f25fcdf2d788b9192b2247919393cbb6f786bb0a7d102eb7405486c81747376e"} Jun 02 01:12:52.322134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.322073 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" event={"ID":"d57fb365-0ee9-427f-986b-75c25cdeb227","Type":"ContainerStarted","Data":"c2ece2d296150de3f6244c4e031dd86b37e735b9b7987c0cb31220ff2fbfd8b3"} Jun 02 01:12:52.325488 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.325416 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-bbcj5" event={"ID":"3a68fc1c-dd93-48e8-9793-46d994db41c6","Type":"ContainerStarted","Data":"4c05f4bc888ac3ac4f22be7f399b58ba4f01873b5c9a3d704f3a44426dbc70b4"} Jun 02 01:12:52.325488 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.325446 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:52.329685 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.329418 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"af2817c88c2586d99a8102315eff179d9f6452f3129a4fc17316d586063d3048"} Jun 02 01:12:52.339758 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.339721 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-bbcj5" Jun 02 01:12:52.344907 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:52.343295 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-bbcj5" podStartSLOduration=2.021698022 podStartE2EDuration="20.343277973s" podCreationTimestamp="2026-06-02 01:12:32 +0000 UTC" firstStartedPulling="2026-06-02 01:12:33.492532592 +0000 UTC m=+117.199498892" lastFinishedPulling="2026-06-02 01:12:51.814112541 +0000 UTC m=+135.521078843" observedRunningTime="2026-06-02 01:12:52.342639702 +0000 UTC m=+136.049606034" watchObservedRunningTime="2026-06-02 01:12:52.343277973 +0000 UTC m=+136.050244293" Jun 02 01:12:55.114681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.114637 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4c4fdc8-wtwrq"] Jun 02 01:12:55.115153 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:55.114978 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" podUID="c7bb0393-b4d4-499d-bd45-a82561632f71" Jun 02 01:12:55.345214 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.345065 2574 generic.go:358] "Generic (PLEG): container finished" podID="4248a1e7-9d7b-4b79-a868-fb9c24388fc1" containerID="1b75a29a2c3898da7a121da60ed6f4b0caf157588bc9e429797c6bf3837bc817" exitCode=0 Jun 02 01:12:55.345214 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.345161 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjcq" event={"ID":"4248a1e7-9d7b-4b79-a868-fb9c24388fc1","Type":"ContainerDied","Data":"1b75a29a2c3898da7a121da60ed6f4b0caf157588bc9e429797c6bf3837bc817"} Jun 02 01:12:55.348176 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.348097 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cns8m" event={"ID":"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3","Type":"ContainerStarted","Data":"8a70ac835d7dfadd5325c742fbdda5370994cba897e8e5bb5f6ebed9a5cebace"} Jun 02 01:12:55.348176 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.348138 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cns8m" event={"ID":"d6b04cb3-93e1-4110-a31b-88b4fd21a5b3","Type":"ContainerStarted","Data":"fa8910222dc2c2ee4f4a690d0de01a0e438658ec48ceba95febb3b998a40ef96"} Jun 02 01:12:55.350521 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.350491 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" event={"ID":"d57fb365-0ee9-427f-986b-75c25cdeb227","Type":"ContainerStarted","Data":"4e5f857f2fc18113b9e6230f4665b834c2a6df9e99e07a656d17f41c7c297d78"} Jun 02 01:12:55.350635 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.350528 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" event={"ID":"d57fb365-0ee9-427f-986b-75c25cdeb227","Type":"ContainerStarted","Data":"ded8e6fb826a92bf287bc71bffcac5ac5fbcacde0c04033e72a5bd8539f61592"} Jun 02 01:12:55.350635 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.350541 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" event={"ID":"d57fb365-0ee9-427f-986b-75c25cdeb227","Type":"ContainerStarted","Data":"121f2aa709cb8f8cbc0d3419b1f5a3d78bfb3a86dfd0cd989194ab974d899134"} Jun 02 01:12:55.356955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.356323 2574 generic.go:358] "Generic (PLEG): container finished" podID="168a02b3-9ad9-4d1e-80ed-994b6d3dc97e" containerID="35e1b99ae461752fc6e50336e27101500ad8033055d757d53dceabdd172e96a5" exitCode=0 Jun 02 01:12:55.356955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.356472 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:12:55.356955 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.356585 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerDied","Data":"35e1b99ae461752fc6e50336e27101500ad8033055d757d53dceabdd172e96a5"} Jun 02 01:12:55.362513 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.362473 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:12:55.381148 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.381064 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cns8m" podStartSLOduration=135.814925745 podStartE2EDuration="2m18.381048641s" podCreationTimestamp="2026-06-02 01:10:37 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.88302427 +0000 UTC m=+135.589990570" lastFinishedPulling="2026-06-02 01:12:54.449147165 +0000 UTC m=+138.156113466" observedRunningTime="2026-06-02 01:12:55.380441637 +0000 UTC m=+139.087407952" watchObservedRunningTime="2026-06-02 01:12:55.381048641 +0000 UTC m=+139.088014962" Jun 02 01:12:55.398265 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.398198 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-xk5qj" podStartSLOduration=7.844639897 podStartE2EDuration="10.398182216s" podCreationTimestamp="2026-06-02 01:12:45 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.898620382 +0000 UTC m=+135.605586685" lastFinishedPulling="2026-06-02 01:12:54.452162699 +0000 UTC m=+138.159129004" observedRunningTime="2026-06-02 01:12:55.396556045 +0000 UTC m=+139.103522364" watchObservedRunningTime="2026-06-02 01:12:55.398182216 +0000 UTC m=+139.105148535" Jun 02 01:12:55.457732 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.457700 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.457882 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.457756 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.457882 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.457789 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.457882 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.457864 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcqzx\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.458082 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.457903 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.458082 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.458043 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.458182 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.458084 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates\") pod \"c7bb0393-b4d4-499d-bd45-a82561632f71\" (UID: \"c7bb0393-b4d4-499d-bd45-a82561632f71\") " Jun 02 01:12:55.458237 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.458202 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:12:55.463642 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.458804 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c7bb0393-b4d4-499d-bd45-a82561632f71-ca-trust-extracted\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.463642 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:55.459278 2574 configmap.go:193] Couldn't get configMap openshift-monitoring/prometheus-k8s-rulefiles-0: configmap "prometheus-k8s-rulefiles-0" not found Jun 02 01:12:55.463642 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:12:55.459338 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-rulefiles-0 podName:168a02b3-9ad9-4d1e-80ed-994b6d3dc97e nodeName:}" failed. No retries permitted until 2026-06-02 01:12:55.959318139 +0000 UTC m=+139.666284453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-k8s-rulefiles-0" (UniqueName: "kubernetes.io/configmap/168a02b3-9ad9-4d1e-80ed-994b6d3dc97e-prometheus-k8s-rulefiles-0") pod "prometheus-k8s-0" (UID: "168a02b3-9ad9-4d1e-80ed-994b6d3dc97e") : configmap "prometheus-k8s-rulefiles-0" not found Jun 02 01:12:55.463642 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.459625 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:12:55.463642 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.461587 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:12:55.464081 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.463666 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx" (OuterVolumeSpecName: "kube-api-access-pcqzx") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "kube-api-access-pcqzx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:12:55.464695 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.464667 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:12:55.468878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.466811 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:12:55.468878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.466907 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c7bb0393-b4d4-499d-bd45-a82561632f71" (UID: "c7bb0393-b4d4-499d-bd45-a82561632f71"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:12:55.561757 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561724 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-bound-sa-token\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.561892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561761 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-trusted-ca\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.561892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561775 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcqzx\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-kube-api-access-pcqzx\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.561892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561792 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-installation-pull-secrets\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.561892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561807 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c7bb0393-b4d4-499d-bd45-a82561632f71-image-registry-private-configuration\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:55.561892 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:55.561821 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-certificates\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:56.364047 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.364013 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjcq" event={"ID":"4248a1e7-9d7b-4b79-a868-fb9c24388fc1","Type":"ContainerStarted","Data":"374763fd288df6cb6e5f8e02466b0ab86da99f84cd0fb5ef46ad6c7beed1ba15"} Jun 02 01:12:56.364047 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.364054 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6zjcq" event={"ID":"4248a1e7-9d7b-4b79-a868-fb9c24388fc1","Type":"ContainerStarted","Data":"7f73991f1c288fc66bbbf7c10b510aa25bf9d7986656cfc966698ce4a559fc31"} Jun 02 01:12:56.364614 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.364589 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b4c4fdc8-wtwrq" Jun 02 01:12:56.382934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.382875 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6zjcq" podStartSLOduration=8.635566266 podStartE2EDuration="11.382858334s" podCreationTimestamp="2026-06-02 01:12:45 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.700087202 +0000 UTC m=+135.407053513" lastFinishedPulling="2026-06-02 01:12:54.447379279 +0000 UTC m=+138.154345581" observedRunningTime="2026-06-02 01:12:56.380706211 +0000 UTC m=+140.087672541" watchObservedRunningTime="2026-06-02 01:12:56.382858334 +0000 UTC m=+140.089824654" Jun 02 01:12:56.410176 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.410142 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7b4c4fdc8-wtwrq"] Jun 02 01:12:56.422818 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.422788 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7b4c4fdc8-wtwrq"] Jun 02 01:12:56.570197 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.570152 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c7bb0393-b4d4-499d-bd45-a82561632f71-registry-tls\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:12:56.800798 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:56.800764 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7bb0393-b4d4-499d-bd45-a82561632f71" path="/var/lib/kubelet/pods/c7bb0393-b4d4-499d-bd45-a82561632f71/volumes" Jun 02 01:12:59.378507 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:59.378467 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"2be197b1fed114d026f47ba3379ad8342d94bb715cc7c2790bea047a27c24d6e"} Jun 02 01:12:59.379008 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:12:59.378534 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"fe376de61b198dd58aa4f1dcd81d824386c50693f0adafefc5987fdab77affbb"} Jun 02 01:13:02.389869 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:02.389837 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"5d027b1bfee8f6ae301c4f5c5df52e8f280e67064d95520de2d88d3238bab5b2"} Jun 02 01:13:02.389869 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:02.389872 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"65bb2132353ee91cae6dfdc78474213510c6928d2df4f533a1bd72e85891bc30"} Jun 02 01:13:02.390334 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:02.389882 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"2c2a9b6a72c73baf4ee8760180f9c442d6822ba5fc2fd93a70afe60b6c0cd6d2"} Jun 02 01:13:02.390334 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:02.389892 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"168a02b3-9ad9-4d1e-80ed-994b6d3dc97e","Type":"ContainerStarted","Data":"f8c7f9900eb06edf40c1ee3a2bc3fe91ace54e2b0cb66a1693f3016b0d825603"} Jun 02 01:13:02.420315 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:02.420269 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.54509609 podStartE2EDuration="11.420254458s" podCreationTimestamp="2026-06-02 01:12:51 +0000 UTC" firstStartedPulling="2026-06-02 01:12:51.873418273 +0000 UTC m=+135.580384572" lastFinishedPulling="2026-06-02 01:13:01.74857664 +0000 UTC m=+145.455542940" observedRunningTime="2026-06-02 01:13:02.418795973 +0000 UTC m=+146.125762304" watchObservedRunningTime="2026-06-02 01:13:02.420254458 +0000 UTC m=+146.127220774" Jun 02 01:13:06.644319 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:06.644290 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:13:13.245532 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:13:13.245489 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-98ph6" podUID="68b1b821-9cfd-44c0-82d7-71129551079f" Jun 02 01:13:13.334933 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:13:13.334895 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8q6qf" podUID="990d3632-d0a1-43f5-8d8c-d0149df6d297" Jun 02 01:13:13.418785 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:13.418753 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:13:13.418935 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:13.418758 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:15.425321 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:15.425248 2574 generic.go:358] "Generic (PLEG): container finished" podID="cd533305-f7c5-4c5b-a020-53787c2314f2" containerID="a84c0abe1247204d5346403b2c556c6ebec430ae8adbad05b08631fd30f711d0" exitCode=0 Jun 02 01:13:15.425321 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:15.425308 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" event={"ID":"cd533305-f7c5-4c5b-a020-53787c2314f2","Type":"ContainerDied","Data":"a84c0abe1247204d5346403b2c556c6ebec430ae8adbad05b08631fd30f711d0"} Jun 02 01:13:15.425679 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:15.425596 2574 scope.go:117] "RemoveContainer" containerID="a84c0abe1247204d5346403b2c556c6ebec430ae8adbad05b08631fd30f711d0" Jun 02 01:13:16.429526 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:16.429495 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-kmnmn" event={"ID":"cd533305-f7c5-4c5b-a020-53787c2314f2","Type":"ContainerStarted","Data":"8102f0f241084799cb82ca39d432fd8b80e4e719b22d5f7c1129c02a27bc08d8"} Jun 02 01:13:18.260164 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.260132 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:13:18.262616 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.262592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68b1b821-9cfd-44c0-82d7-71129551079f-cert\") pod \"ingress-canary-98ph6\" (UID: \"68b1b821-9cfd-44c0-82d7-71129551079f\") " pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:13:18.360814 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.360783 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:18.362943 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.362924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/990d3632-d0a1-43f5-8d8c-d0149df6d297-metrics-tls\") pod \"dns-default-8q6qf\" (UID: \"990d3632-d0a1-43f5-8d8c-d0149df6d297\") " pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:18.522444 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.522372 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9tnxm\"" Jun 02 01:13:18.523465 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.523449 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n98qz\"" Jun 02 01:13:18.530345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.530330 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-98ph6" Jun 02 01:13:18.530435 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.530420 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:18.679420 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.679388 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8q6qf"] Jun 02 01:13:18.683935 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:13:18.683904 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990d3632_d0a1_43f5_8d8c_d0149df6d297.slice/crio-ee04261af3e643c88928bf0ef7d3e6e22871f0aaae2e8141c9abaf20c7a6f5d8 WatchSource:0}: Error finding container ee04261af3e643c88928bf0ef7d3e6e22871f0aaae2e8141c9abaf20c7a6f5d8: Status 404 returned error can't find the container with id ee04261af3e643c88928bf0ef7d3e6e22871f0aaae2e8141c9abaf20c7a6f5d8 Jun 02 01:13:18.697706 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:18.697680 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-98ph6"] Jun 02 01:13:18.700574 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:13:18.700551 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b1b821_9cfd_44c0_82d7_71129551079f.slice/crio-6e79e3450151904946e395b06130c9ffbaf7de350c39200e752f4cd84730f88f WatchSource:0}: Error finding container 6e79e3450151904946e395b06130c9ffbaf7de350c39200e752f4cd84730f88f: Status 404 returned error can't find the container with id 6e79e3450151904946e395b06130c9ffbaf7de350c39200e752f4cd84730f88f Jun 02 01:13:19.443163 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:19.443108 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98ph6" event={"ID":"68b1b821-9cfd-44c0-82d7-71129551079f","Type":"ContainerStarted","Data":"6e79e3450151904946e395b06130c9ffbaf7de350c39200e752f4cd84730f88f"} Jun 02 01:13:19.444693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:19.444660 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6qf" event={"ID":"990d3632-d0a1-43f5-8d8c-d0149df6d297","Type":"ContainerStarted","Data":"ee04261af3e643c88928bf0ef7d3e6e22871f0aaae2e8141c9abaf20c7a6f5d8"} Jun 02 01:13:22.456693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.456655 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6qf" event={"ID":"990d3632-d0a1-43f5-8d8c-d0149df6d297","Type":"ContainerStarted","Data":"725a597a8593d765a96af875c19ec9fd3852973e4da149792fe8b85507947b8a"} Jun 02 01:13:22.456693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.456697 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8q6qf" event={"ID":"990d3632-d0a1-43f5-8d8c-d0149df6d297","Type":"ContainerStarted","Data":"61eee71d61213c46b84623326262836b9ea5b60b5637e56b9556ec4b62022119"} Jun 02 01:13:22.457183 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.456750 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:22.457879 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.457856 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-98ph6" event={"ID":"68b1b821-9cfd-44c0-82d7-71129551079f","Type":"ContainerStarted","Data":"6346ac40d6241e6220feaef5de684b6b0ba81cd64a0b57063c3fcf3806ccf297"} Jun 02 01:13:22.473639 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.473595 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8q6qf" podStartSLOduration=129.741835903 podStartE2EDuration="2m12.473583775s" podCreationTimestamp="2026-06-02 01:11:10 +0000 UTC" firstStartedPulling="2026-06-02 01:13:18.685888493 +0000 UTC m=+162.392854793" lastFinishedPulling="2026-06-02 01:13:21.417636361 +0000 UTC m=+165.124602665" observedRunningTime="2026-06-02 01:13:22.471525635 +0000 UTC m=+166.178491944" watchObservedRunningTime="2026-06-02 01:13:22.473583775 +0000 UTC m=+166.180550093" Jun 02 01:13:22.486713 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:22.486674 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-98ph6" podStartSLOduration=129.775737705 podStartE2EDuration="2m12.48666296s" podCreationTimestamp="2026-06-02 01:11:10 +0000 UTC" firstStartedPulling="2026-06-02 01:13:18.702244249 +0000 UTC m=+162.409210545" lastFinishedPulling="2026-06-02 01:13:21.413169501 +0000 UTC m=+165.120135800" observedRunningTime="2026-06-02 01:13:22.485112301 +0000 UTC m=+166.192078620" watchObservedRunningTime="2026-06-02 01:13:22.48666296 +0000 UTC m=+166.193629279" Jun 02 01:13:24.465077 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:24.465038 2574 generic.go:358] "Generic (PLEG): container finished" podID="d1a16c67-2f9d-4f2d-82cd-44ce034776b0" containerID="5d205baf9bf53cf580fa8a6867ed88253418d02f5ed05dd748384200497a31d4" exitCode=0 Jun 02 01:13:24.465603 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:24.465094 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" event={"ID":"d1a16c67-2f9d-4f2d-82cd-44ce034776b0","Type":"ContainerDied","Data":"5d205baf9bf53cf580fa8a6867ed88253418d02f5ed05dd748384200497a31d4"} Jun 02 01:13:24.465603 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:24.465479 2574 scope.go:117] "RemoveContainer" containerID="5d205baf9bf53cf580fa8a6867ed88253418d02f5ed05dd748384200497a31d4" Jun 02 01:13:25.378909 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:25.378884 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6qf_990d3632-d0a1-43f5-8d8c-d0149df6d297/dns/0.log" Jun 02 01:13:25.384816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:25.384790 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6qf_990d3632-d0a1-43f5-8d8c-d0149df6d297/kube-rbac-proxy/0.log" Jun 02 01:13:25.469507 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:25.469471 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-tl6jd" event={"ID":"d1a16c67-2f9d-4f2d-82cd-44ce034776b0","Type":"ContainerStarted","Data":"c864e978b32e35477b9810612ce1a69afc3928dacaca990db6ef069a68a4a009"} Jun 02 01:13:25.475569 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:25.475546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h987k_89f2be46-581c-4926-8631-dbff6e479f27/dns-node-resolver/0.log" Jun 02 01:13:28.480384 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:28.480352 2574 generic.go:358] "Generic (PLEG): container finished" podID="5dd867a7-f801-421e-a366-dd3daf7e7402" containerID="f8f833a3e42245a2249af016363313f87e082fb9df4d107ed2e694831848bf03" exitCode=0 Jun 02 01:13:28.480739 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:28.480431 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" event={"ID":"5dd867a7-f801-421e-a366-dd3daf7e7402","Type":"ContainerDied","Data":"f8f833a3e42245a2249af016363313f87e082fb9df4d107ed2e694831848bf03"} Jun 02 01:13:28.480739 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:28.480715 2574 scope.go:117] "RemoveContainer" containerID="f8f833a3e42245a2249af016363313f87e082fb9df4d107ed2e694831848bf03" Jun 02 01:13:29.485067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:29.485033 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-qfv92" event={"ID":"5dd867a7-f801-421e-a366-dd3daf7e7402","Type":"ContainerStarted","Data":"a3ccb57d1f4934f47ed24477c4db506384b6d3e563f84a794451193142e66bdc"} Jun 02 01:13:32.463129 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:32.463093 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8q6qf" Jun 02 01:13:51.643850 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:51.643807 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:13:51.659566 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:51.659542 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:13:52.567363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:13:52.567335 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 01:15:36.754057 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:15:36.754029 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:15:36.754617 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:15:36.754059 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:15:36.758449 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:15:36.758422 2574 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 01:16:31.212814 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.212729 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b"] Jun 02 01:16:31.215898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.215881 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.222254 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.222232 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 01:16:31.222382 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.222238 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cgjh5\"" Jun 02 01:16:31.222782 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.222248 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 01:16:31.222782 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.222472 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 01:16:31.222782 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.222273 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 01:16:31.238454 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.238430 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b"] Jun 02 01:16:31.306773 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.306735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.306939 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.306803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.306939 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.306847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldtks\" (UniqueName: \"kubernetes.io/projected/a93d48db-1673-42c1-b892-a4f98971923f-kube-api-access-ldtks\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.306939 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.306879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.307100 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.306942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408116 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408079 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408127 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldtks\" (UniqueName: \"kubernetes.io/projected/a93d48db-1673-42c1-b892-a4f98971923f-kube-api-access-ldtks\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408149 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408176 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408214 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.408526 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.408501 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-manifests\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.410565 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.410536 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93d48db-1673-42c1-b892-a4f98971923f-tmp\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.410739 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.410719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.410780 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.410743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a93d48db-1673-42c1-b892-a4f98971923f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.422259 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.422241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldtks\" (UniqueName: \"kubernetes.io/projected/a93d48db-1673-42c1-b892-a4f98971923f-kube-api-access-ldtks\") pod \"opendatahub-operator-controller-manager-5bc8cb464b-vc27b\" (UID: \"a93d48db-1673-42c1-b892-a4f98971923f\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.525910 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.525883 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:31.659218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.659187 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b"] Jun 02 01:16:31.662220 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:16:31.662193 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93d48db_1673_42c1_b892_a4f98971923f.slice/crio-980514d6c1ac336634aeea0bf93e011877a7183131c5402c52889b1cc76b3f36 WatchSource:0}: Error finding container 980514d6c1ac336634aeea0bf93e011877a7183131c5402c52889b1cc76b3f36: Status 404 returned error can't find the container with id 980514d6c1ac336634aeea0bf93e011877a7183131c5402c52889b1cc76b3f36 Jun 02 01:16:31.663730 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.663716 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:16:31.978314 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:31.978234 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" event={"ID":"a93d48db-1673-42c1-b892-a4f98971923f","Type":"ContainerStarted","Data":"980514d6c1ac336634aeea0bf93e011877a7183131c5402c52889b1cc76b3f36"} Jun 02 01:16:34.991459 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:34.991426 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" event={"ID":"a93d48db-1673-42c1-b892-a4f98971923f","Type":"ContainerStarted","Data":"a4a2c20fe1e50736c81f024e8832a2993f005ba7bf00e69307f9efd937b6a5cf"} Jun 02 01:16:35.995634 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:35.995596 2574 generic.go:358] "Generic (PLEG): container finished" podID="a93d48db-1673-42c1-b892-a4f98971923f" containerID="a4a2c20fe1e50736c81f024e8832a2993f005ba7bf00e69307f9efd937b6a5cf" exitCode=0 Jun 02 01:16:35.996063 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:35.995643 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" event={"ID":"a93d48db-1673-42c1-b892-a4f98971923f","Type":"ContainerDied","Data":"a4a2c20fe1e50736c81f024e8832a2993f005ba7bf00e69307f9efd937b6a5cf"} Jun 02 01:16:36.999806 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:36.999769 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" event={"ID":"a93d48db-1673-42c1-b892-a4f98971923f","Type":"ContainerStarted","Data":"e8f2ebdddbbb9f83b5e85f2140abeb45bc4f781a56d23803fe48f212cb735313"} Jun 02 01:16:37.000292 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:36.999913 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:37.020610 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:37.020565 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" podStartSLOduration=1.342460067 podStartE2EDuration="6.020553497s" podCreationTimestamp="2026-06-02 01:16:31 +0000 UTC" firstStartedPulling="2026-06-02 01:16:31.663834238 +0000 UTC m=+355.370800535" lastFinishedPulling="2026-06-02 01:16:36.341927665 +0000 UTC m=+360.048893965" observedRunningTime="2026-06-02 01:16:37.018613941 +0000 UTC m=+360.725580248" watchObservedRunningTime="2026-06-02 01:16:37.020553497 +0000 UTC m=+360.727519816" Jun 02 01:16:48.005314 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:48.005280 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8cb464b-vc27b" Jun 02 01:16:51.063125 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.063086 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f"] Jun 02 01:16:51.071205 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.071178 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.085316 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085289 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 01:16:51.085433 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085320 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 01:16:51.085433 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085329 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:16:51.085433 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085320 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 01:16:51.085553 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085440 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 01:16:51.085629 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.085614 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zmz2t\"" Jun 02 01:16:51.097269 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.097247 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f"] Jun 02 01:16:51.172642 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.172611 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d81578-788f-4517-9785-a9da6060f09d-manager-config\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.172799 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.172654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-metrics-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.172799 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.172686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpqw8\" (UniqueName: \"kubernetes.io/projected/52d81578-788f-4517-9785-a9da6060f09d-kube-api-access-hpqw8\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.172799 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.172720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.273161 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.273127 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.273318 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.273197 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d81578-788f-4517-9785-a9da6060f09d-manager-config\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.273318 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.273222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-metrics-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.273318 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.273240 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpqw8\" (UniqueName: \"kubernetes.io/projected/52d81578-788f-4517-9785-a9da6060f09d-kube-api-access-hpqw8\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.273813 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.273793 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/52d81578-788f-4517-9785-a9da6060f09d-manager-config\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.275746 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.275718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.275877 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.275722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/52d81578-788f-4517-9785-a9da6060f09d-metrics-cert\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.282934 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.282909 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpqw8\" (UniqueName: \"kubernetes.io/projected/52d81578-788f-4517-9785-a9da6060f09d-kube-api-access-hpqw8\") pod \"lws-controller-manager-5c7648845d-fk47f\" (UID: \"52d81578-788f-4517-9785-a9da6060f09d\") " pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.380225 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.380149 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:51.503181 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:51.503150 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f"] Jun 02 01:16:51.505539 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:16:51.505509 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d81578_788f_4517_9785_a9da6060f09d.slice/crio-23bf7ef96e15e0ddd6c5459fcf4066fe571ced01c3e5e6fd20e9cc4bda69e824 WatchSource:0}: Error finding container 23bf7ef96e15e0ddd6c5459fcf4066fe571ced01c3e5e6fd20e9cc4bda69e824: Status 404 returned error can't find the container with id 23bf7ef96e15e0ddd6c5459fcf4066fe571ced01c3e5e6fd20e9cc4bda69e824 Jun 02 01:16:52.048423 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:52.048386 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" event={"ID":"52d81578-788f-4517-9785-a9da6060f09d","Type":"ContainerStarted","Data":"23bf7ef96e15e0ddd6c5459fcf4066fe571ced01c3e5e6fd20e9cc4bda69e824"} Jun 02 01:16:54.055507 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:54.055474 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" event={"ID":"52d81578-788f-4517-9785-a9da6060f09d","Type":"ContainerStarted","Data":"411d46081d5f5b5d64563c5dddd3e5513f067d54abcd320ca701fa42b59a9df8"} Jun 02 01:16:54.055932 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:54.055618 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:16:54.072439 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:16:54.072399 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" podStartSLOduration=0.826285237 podStartE2EDuration="3.072385774s" podCreationTimestamp="2026-06-02 01:16:51 +0000 UTC" firstStartedPulling="2026-06-02 01:16:51.507258135 +0000 UTC m=+375.214224433" lastFinishedPulling="2026-06-02 01:16:53.753358669 +0000 UTC m=+377.460324970" observedRunningTime="2026-06-02 01:16:54.070195188 +0000 UTC m=+377.777161507" watchObservedRunningTime="2026-06-02 01:16:54.072385774 +0000 UTC m=+377.779352095" Jun 02 01:17:05.061927 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:05.061900 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c7648845d-fk47f" Jun 02 01:17:05.998350 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:05.998319 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-99f5j"] Jun 02 01:17:06.001762 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.001739 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.004636 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.004603 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 01:17:06.004783 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.004677 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fcj8c\"" Jun 02 01:17:06.016457 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.016408 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-99f5j"] Jun 02 01:17:06.106607 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.106562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.107024 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.106674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qbx\" (UniqueName: \"kubernetes.io/projected/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-kube-api-access-49qbx\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.207916 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.207880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.208121 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.207938 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49qbx\" (UniqueName: \"kubernetes.io/projected/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-kube-api-access-49qbx\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.208655 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.208629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-redirect-config\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.217503 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.217480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qbx\" (UniqueName: \"kubernetes.io/projected/d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61-kube-api-access-49qbx\") pod \"dashboard-redirect-78fffc7cf9-99f5j\" (UID: \"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61\") " pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.312209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.312179 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" Jun 02 01:17:06.453472 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:06.453442 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78fffc7cf9-99f5j"] Jun 02 01:17:06.455613 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:17:06.455579 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c66e9d_8cbd_4d6e_86df_13fd27a0dd61.slice/crio-1ab34b67b19aed3d5e005cf121f3ed75fb9e7e102f35b9256301952c46e0653b WatchSource:0}: Error finding container 1ab34b67b19aed3d5e005cf121f3ed75fb9e7e102f35b9256301952c46e0653b: Status 404 returned error can't find the container with id 1ab34b67b19aed3d5e005cf121f3ed75fb9e7e102f35b9256301952c46e0653b Jun 02 01:17:07.098339 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:07.098283 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" event={"ID":"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61","Type":"ContainerStarted","Data":"1ab34b67b19aed3d5e005cf121f3ed75fb9e7e102f35b9256301952c46e0653b"} Jun 02 01:17:09.105146 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:09.105108 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" event={"ID":"d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61","Type":"ContainerStarted","Data":"1d62ff67a8d0c7ee66dc2b6dd64c9faa3f2ee17abea0e167bf890a45a88d7b4a"} Jun 02 01:17:09.125281 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:09.125216 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78fffc7cf9-99f5j" podStartSLOduration=2.5122977 podStartE2EDuration="4.125201933s" podCreationTimestamp="2026-06-02 01:17:05 +0000 UTC" firstStartedPulling="2026-06-02 01:17:06.457190528 +0000 UTC m=+390.164156840" lastFinishedPulling="2026-06-02 01:17:08.07009477 +0000 UTC m=+391.777061073" observedRunningTime="2026-06-02 01:17:09.124276978 +0000 UTC m=+392.831243320" watchObservedRunningTime="2026-06-02 01:17:09.125201933 +0000 UTC m=+392.832168252" Jun 02 01:17:25.935861 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.935825 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s"] Jun 02 01:17:25.939705 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.939679 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.942514 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.942490 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-ftl66\"" Jun 02 01:17:25.942933 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.942917 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 01:17:25.951217 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.951189 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s"] Jun 02 01:17:25.979145 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njf7n\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-kube-api-access-njf7n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979458 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979511 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979568 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979524 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:25.979568 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:25.979555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080725 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080687 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080734 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080786 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080843 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080870 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.080913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080898 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081304 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080933 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081304 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.080993 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-njf7n\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-kube-api-access-njf7n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081304 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.081219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.081417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.081431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081578 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.081512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.081578 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.081545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.083772 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.083743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.083921 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.083903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.091057 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.091032 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.091206 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.091195 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njf7n\" (UniqueName: \"kubernetes.io/projected/b8a22ad1-4eb4-4395-b554-14cc3f13b6b6-kube-api-access-njf7n\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzm87s\" (UID: \"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.250313 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.250225 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:26.384763 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:26.384731 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s"] Jun 02 01:17:26.389046 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:17:26.389011 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a22ad1_4eb4_4395_b554_14cc3f13b6b6.slice/crio-c3efc8aa7425cbf6edfafb37334975b868c9f3341e589621f87f0d9920d46f18 WatchSource:0}: Error finding container c3efc8aa7425cbf6edfafb37334975b868c9f3341e589621f87f0d9920d46f18: Status 404 returned error can't find the container with id c3efc8aa7425cbf6edfafb37334975b868c9f3341e589621f87f0d9920d46f18 Jun 02 01:17:27.161842 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:27.161803 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" event={"ID":"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6","Type":"ContainerStarted","Data":"c3efc8aa7425cbf6edfafb37334975b868c9f3341e589621f87f0d9920d46f18"} Jun 02 01:17:28.917563 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:28.917525 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:17:28.917815 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:28.917602 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:17:28.917815 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:28.917631 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:17:29.170076 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:29.169978 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" event={"ID":"b8a22ad1-4eb4-4395-b554-14cc3f13b6b6","Type":"ContainerStarted","Data":"2ca5f2a13bf5cd4d9119dc4113b67905be37edaef4281ea50ea957315bd0bad1"} Jun 02 01:17:29.189420 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:29.189369 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" podStartSLOduration=1.663050482 podStartE2EDuration="4.189354706s" podCreationTimestamp="2026-06-02 01:17:25 +0000 UTC" firstStartedPulling="2026-06-02 01:17:26.39099075 +0000 UTC m=+410.097957050" lastFinishedPulling="2026-06-02 01:17:28.917294972 +0000 UTC m=+412.624261274" observedRunningTime="2026-06-02 01:17:29.187610794 +0000 UTC m=+412.894577116" watchObservedRunningTime="2026-06-02 01:17:29.189354706 +0000 UTC m=+412.896321095" Jun 02 01:17:29.250640 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:29.250602 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:29.251974 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:29.251933 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jun 02 01:17:29.252084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:29.252006 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" podUID="b8a22ad1-4eb4-4395-b554-14cc3f13b6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jun 02 01:17:30.251068 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:30.251032 2574 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" start-of-body= Jun 02 01:17:30.251454 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:30.251088 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" podUID="b8a22ad1-4eb4-4395-b554-14cc3f13b6b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.25:15021/healthz/ready\": dial tcp 10.132.0.25:15021: connect: connection refused" Jun 02 01:17:31.254939 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:31.254909 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:32.179376 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:32.179346 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:32.180527 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:32.180503 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzm87s" Jun 02 01:17:51.251398 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.251365 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:51.262833 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.262805 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:51.265516 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.265488 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 01:17:51.266486 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.266457 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:51.266747 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.266720 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 01:17:51.266852 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.266828 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-57ldt\"" Jun 02 01:17:51.400953 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.400919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7nxv\" (UniqueName: \"kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv\") pod \"kuadrant-operator-catalog-kz8qb\" (UID: \"80cf944b-46db-423e-a1f2-3449d1afe7c8\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:51.501927 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.501839 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7nxv\" (UniqueName: \"kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv\") pod \"kuadrant-operator-catalog-kz8qb\" (UID: \"80cf944b-46db-423e-a1f2-3449d1afe7c8\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:51.510776 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.510745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7nxv\" (UniqueName: \"kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv\") pod \"kuadrant-operator-catalog-kz8qb\" (UID: \"80cf944b-46db-423e-a1f2-3449d1afe7c8\") " pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:51.574656 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.574618 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:51.624778 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.624747 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:51.701344 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.701318 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:51.703826 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:17:51.703797 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cf944b_46db_423e_a1f2_3449d1afe7c8.slice/crio-839e0a8dead598ffa9ac1bba7f1e8d2bece246788f1026d2710fa09ca9a882df WatchSource:0}: Error finding container 839e0a8dead598ffa9ac1bba7f1e8d2bece246788f1026d2710fa09ca9a882df: Status 404 returned error can't find the container with id 839e0a8dead598ffa9ac1bba7f1e8d2bece246788f1026d2710fa09ca9a882df Jun 02 01:17:51.836323 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.833984 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4nvmd"] Jun 02 01:17:51.840130 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.840102 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:17:51.843168 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:51.843143 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4nvmd"] Jun 02 01:17:52.005163 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.005129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5d6m\" (UniqueName: \"kubernetes.io/projected/c5562131-4638-49a0-8260-73d7b77b8057-kube-api-access-n5d6m\") pod \"kuadrant-operator-catalog-4nvmd\" (UID: \"c5562131-4638-49a0-8260-73d7b77b8057\") " pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:17:52.105896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.105825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5d6m\" (UniqueName: \"kubernetes.io/projected/c5562131-4638-49a0-8260-73d7b77b8057-kube-api-access-n5d6m\") pod \"kuadrant-operator-catalog-4nvmd\" (UID: \"c5562131-4638-49a0-8260-73d7b77b8057\") " pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:17:52.114131 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.114106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5d6m\" (UniqueName: \"kubernetes.io/projected/c5562131-4638-49a0-8260-73d7b77b8057-kube-api-access-n5d6m\") pod \"kuadrant-operator-catalog-4nvmd\" (UID: \"c5562131-4638-49a0-8260-73d7b77b8057\") " pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:17:52.150748 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.150713 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:17:52.247282 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.247248 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" event={"ID":"80cf944b-46db-423e-a1f2-3449d1afe7c8","Type":"ContainerStarted","Data":"839e0a8dead598ffa9ac1bba7f1e8d2bece246788f1026d2710fa09ca9a882df"} Jun 02 01:17:52.276348 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:52.276325 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4nvmd"] Jun 02 01:17:52.278265 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:17:52.278234 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5562131_4638_49a0_8260_73d7b77b8057.slice/crio-6908e7056119ec49d87c666a94a11c65189ac965e50d9a6f1300deb7e1b563f7 WatchSource:0}: Error finding container 6908e7056119ec49d87c666a94a11c65189ac965e50d9a6f1300deb7e1b563f7: Status 404 returned error can't find the container with id 6908e7056119ec49d87c666a94a11c65189ac965e50d9a6f1300deb7e1b563f7 Jun 02 01:17:53.252186 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:53.252146 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" event={"ID":"c5562131-4638-49a0-8260-73d7b77b8057","Type":"ContainerStarted","Data":"6908e7056119ec49d87c666a94a11c65189ac965e50d9a6f1300deb7e1b563f7"} Jun 02 01:17:54.256974 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.256924 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" event={"ID":"80cf944b-46db-423e-a1f2-3449d1afe7c8","Type":"ContainerStarted","Data":"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9"} Jun 02 01:17:54.257425 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.257098 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" podUID="80cf944b-46db-423e-a1f2-3449d1afe7c8" containerName="registry-server" containerID="cri-o://19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9" gracePeriod=2 Jun 02 01:17:54.258450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.258426 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" event={"ID":"c5562131-4638-49a0-8260-73d7b77b8057","Type":"ContainerStarted","Data":"cb5ef1df786e7e5cec841434557a7a480b60d910c558b451ba50a2d274b4ba1c"} Jun 02 01:17:54.273816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.273773 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" podStartSLOduration=1.20034012 podStartE2EDuration="3.273758782s" podCreationTimestamp="2026-06-02 01:17:51 +0000 UTC" firstStartedPulling="2026-06-02 01:17:51.705177666 +0000 UTC m=+435.412143963" lastFinishedPulling="2026-06-02 01:17:53.778596324 +0000 UTC m=+437.485562625" observedRunningTime="2026-06-02 01:17:54.272290803 +0000 UTC m=+437.979257125" watchObservedRunningTime="2026-06-02 01:17:54.273758782 +0000 UTC m=+437.980725100" Jun 02 01:17:54.286425 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.286380 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" podStartSLOduration=1.786821357 podStartE2EDuration="3.286367347s" podCreationTimestamp="2026-06-02 01:17:51 +0000 UTC" firstStartedPulling="2026-06-02 01:17:52.279564104 +0000 UTC m=+435.986530401" lastFinishedPulling="2026-06-02 01:17:53.779110094 +0000 UTC m=+437.486076391" observedRunningTime="2026-06-02 01:17:54.285571068 +0000 UTC m=+437.992537389" watchObservedRunningTime="2026-06-02 01:17:54.286367347 +0000 UTC m=+437.993333667" Jun 02 01:17:54.503733 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.503710 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:54.631553 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.631523 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7nxv\" (UniqueName: \"kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv\") pod \"80cf944b-46db-423e-a1f2-3449d1afe7c8\" (UID: \"80cf944b-46db-423e-a1f2-3449d1afe7c8\") " Jun 02 01:17:54.633665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.633639 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv" (OuterVolumeSpecName: "kube-api-access-f7nxv") pod "80cf944b-46db-423e-a1f2-3449d1afe7c8" (UID: "80cf944b-46db-423e-a1f2-3449d1afe7c8"). InnerVolumeSpecName "kube-api-access-f7nxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:17:54.732695 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:54.732661 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7nxv\" (UniqueName: \"kubernetes.io/projected/80cf944b-46db-423e-a1f2-3449d1afe7c8-kube-api-access-f7nxv\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:17:55.262763 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.262729 2574 generic.go:358] "Generic (PLEG): container finished" podID="80cf944b-46db-423e-a1f2-3449d1afe7c8" containerID="19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9" exitCode=0 Jun 02 01:17:55.263218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.262780 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" event={"ID":"80cf944b-46db-423e-a1f2-3449d1afe7c8","Type":"ContainerDied","Data":"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9"} Jun 02 01:17:55.263218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.262822 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" event={"ID":"80cf944b-46db-423e-a1f2-3449d1afe7c8","Type":"ContainerDied","Data":"839e0a8dead598ffa9ac1bba7f1e8d2bece246788f1026d2710fa09ca9a882df"} Jun 02 01:17:55.263218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.262839 2574 scope.go:117] "RemoveContainer" containerID="19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9" Jun 02 01:17:55.263218 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.262786 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kz8qb" Jun 02 01:17:55.271367 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.271346 2574 scope.go:117] "RemoveContainer" containerID="19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9" Jun 02 01:17:55.271615 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:17:55.271598 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9\": container with ID starting with 19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9 not found: ID does not exist" containerID="19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9" Jun 02 01:17:55.271662 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.271624 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9"} err="failed to get container status \"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9\": rpc error: code = NotFound desc = could not find container \"19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9\": container with ID starting with 19bd4cf794f7f0ff90822640cf3e518a2f309b1b705e74789ecb3811cf7850d9 not found: ID does not exist" Jun 02 01:17:55.278590 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.278546 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:55.280697 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:55.280674 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kz8qb"] Jun 02 01:17:56.797653 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:17:56.797620 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80cf944b-46db-423e-a1f2-3449d1afe7c8" path="/var/lib/kubelet/pods/80cf944b-46db-423e-a1f2-3449d1afe7c8/volumes" Jun 02 01:18:02.151862 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:02.151838 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:18:02.151862 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:02.151868 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:18:02.174028 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:02.174006 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:18:02.310069 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:02.310039 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4nvmd" Jun 02 01:18:22.851010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.850977 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b"] Jun 02 01:18:22.851473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.851348 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80cf944b-46db-423e-a1f2-3449d1afe7c8" containerName="registry-server" Jun 02 01:18:22.851473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.851361 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="80cf944b-46db-423e-a1f2-3449d1afe7c8" containerName="registry-server" Jun 02 01:18:22.851473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.851427 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="80cf944b-46db-423e-a1f2-3449d1afe7c8" containerName="registry-server" Jun 02 01:18:22.855827 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.855811 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:22.858719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.858694 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n27ww\"" Jun 02 01:18:22.858841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.858737 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 01:18:22.864082 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.864035 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b"] Jun 02 01:18:22.964628 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:22.964595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46p4p\" (UniqueName: \"kubernetes.io/projected/fcfb211d-629a-4018-9869-8a3b04738b43-kube-api-access-46p4p\") pod \"dns-operator-controller-manager-648d5c98bc-kbw8b\" (UID: \"fcfb211d-629a-4018-9869-8a3b04738b43\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:23.065726 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:23.065697 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46p4p\" (UniqueName: \"kubernetes.io/projected/fcfb211d-629a-4018-9869-8a3b04738b43-kube-api-access-46p4p\") pod \"dns-operator-controller-manager-648d5c98bc-kbw8b\" (UID: \"fcfb211d-629a-4018-9869-8a3b04738b43\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:23.079400 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:23.079374 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46p4p\" (UniqueName: \"kubernetes.io/projected/fcfb211d-629a-4018-9869-8a3b04738b43-kube-api-access-46p4p\") pod \"dns-operator-controller-manager-648d5c98bc-kbw8b\" (UID: \"fcfb211d-629a-4018-9869-8a3b04738b43\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:23.166503 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:23.166442 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:23.297520 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:23.297495 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b"] Jun 02 01:18:23.299447 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:18:23.299421 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfb211d_629a_4018_9869_8a3b04738b43.slice/crio-3c6c7f72a07bd2c952746d1cb6ecc486ef68879ce66e21f317eaf333b65c79ba WatchSource:0}: Error finding container 3c6c7f72a07bd2c952746d1cb6ecc486ef68879ce66e21f317eaf333b65c79ba: Status 404 returned error can't find the container with id 3c6c7f72a07bd2c952746d1cb6ecc486ef68879ce66e21f317eaf333b65c79ba Jun 02 01:18:23.359870 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:23.359839 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" event={"ID":"fcfb211d-629a-4018-9869-8a3b04738b43","Type":"ContainerStarted","Data":"3c6c7f72a07bd2c952746d1cb6ecc486ef68879ce66e21f317eaf333b65c79ba"} Jun 02 01:18:25.369696 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:25.369601 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" event={"ID":"fcfb211d-629a-4018-9869-8a3b04738b43","Type":"ContainerStarted","Data":"3b7faba8af69fdcc8a6d2d3d1224375ad29e5851ba7a9efa58f7d84f77bd9d7f"} Jun 02 01:18:25.369696 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:25.369649 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:25.390367 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:25.390252 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" podStartSLOduration=1.630395326 podStartE2EDuration="3.390236322s" podCreationTimestamp="2026-06-02 01:18:22 +0000 UTC" firstStartedPulling="2026-06-02 01:18:23.301487719 +0000 UTC m=+467.008454015" lastFinishedPulling="2026-06-02 01:18:25.061328713 +0000 UTC m=+468.768295011" observedRunningTime="2026-06-02 01:18:25.39022442 +0000 UTC m=+469.097190740" watchObservedRunningTime="2026-06-02 01:18:25.390236322 +0000 UTC m=+469.097202642" Jun 02 01:18:28.154723 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.154687 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4"] Jun 02 01:18:28.162412 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.162395 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.165387 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.165361 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tlvdh\"" Jun 02 01:18:28.166622 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.166598 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4"] Jun 02 01:18:28.313715 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.313679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.313885 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.313744 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqnjx\" (UniqueName: \"kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.414374 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.414292 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.414374 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.414352 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqnjx\" (UniqueName: \"kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.414777 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.414760 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.438029 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.438004 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqnjx\" (UniqueName: \"kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.473857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.473830 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:28.604536 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:28.604511 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4"] Jun 02 01:18:28.607896 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:18:28.607860 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f311a2d_f744_4437_8465_fa9c9f190d4a.slice/crio-298dee9b573540cd3be8cf6b63c7d4ab483c90a9c5740db1ea5b37ef3fd22b81 WatchSource:0}: Error finding container 298dee9b573540cd3be8cf6b63c7d4ab483c90a9c5740db1ea5b37ef3fd22b81: Status 404 returned error can't find the container with id 298dee9b573540cd3be8cf6b63c7d4ab483c90a9c5740db1ea5b37ef3fd22b81 Jun 02 01:18:29.383785 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:29.383751 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" event={"ID":"5f311a2d-f744-4437-8465-fa9c9f190d4a","Type":"ContainerStarted","Data":"298dee9b573540cd3be8cf6b63c7d4ab483c90a9c5740db1ea5b37ef3fd22b81"} Jun 02 01:18:31.765305 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.765269 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z9tzr"] Jun 02 01:18:31.769046 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.769022 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:31.773841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.773644 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bm7bl\"" Jun 02 01:18:31.790278 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.790252 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z9tzr"] Jun 02 01:18:31.843518 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.843482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swm2b\" (UniqueName: \"kubernetes.io/projected/92973bee-17e5-4759-934a-1769275a9929-kube-api-access-swm2b\") pod \"authorino-operator-657f44b778-z9tzr\" (UID: \"92973bee-17e5-4759-934a-1769275a9929\") " pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:31.944262 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.944209 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swm2b\" (UniqueName: \"kubernetes.io/projected/92973bee-17e5-4759-934a-1769275a9929-kube-api-access-swm2b\") pod \"authorino-operator-657f44b778-z9tzr\" (UID: \"92973bee-17e5-4759-934a-1769275a9929\") " pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:31.954591 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:31.954535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swm2b\" (UniqueName: \"kubernetes.io/projected/92973bee-17e5-4759-934a-1769275a9929-kube-api-access-swm2b\") pod \"authorino-operator-657f44b778-z9tzr\" (UID: \"92973bee-17e5-4759-934a-1769275a9929\") " pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:32.081752 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.081730 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:32.227704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.227670 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-z9tzr"] Jun 02 01:18:32.231429 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:18:32.231401 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92973bee_17e5_4759_934a_1769275a9929.slice/crio-04eebd84312105ce40711d9ec583168b6c7540d416946d90e68d56f7059293e6 WatchSource:0}: Error finding container 04eebd84312105ce40711d9ec583168b6c7540d416946d90e68d56f7059293e6: Status 404 returned error can't find the container with id 04eebd84312105ce40711d9ec583168b6c7540d416946d90e68d56f7059293e6 Jun 02 01:18:32.395160 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.395066 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" event={"ID":"5f311a2d-f744-4437-8465-fa9c9f190d4a","Type":"ContainerStarted","Data":"422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae"} Jun 02 01:18:32.395302 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.395231 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:32.396099 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.396073 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" event={"ID":"92973bee-17e5-4759-934a-1769275a9929","Type":"ContainerStarted","Data":"04eebd84312105ce40711d9ec583168b6c7540d416946d90e68d56f7059293e6"} Jun 02 01:18:32.419423 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:32.419369 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" podStartSLOduration=0.993413167 podStartE2EDuration="4.419354152s" podCreationTimestamp="2026-06-02 01:18:28 +0000 UTC" firstStartedPulling="2026-06-02 01:18:28.61089406 +0000 UTC m=+472.317860357" lastFinishedPulling="2026-06-02 01:18:32.036835046 +0000 UTC m=+475.743801342" observedRunningTime="2026-06-02 01:18:32.416359293 +0000 UTC m=+476.123325611" watchObservedRunningTime="2026-06-02 01:18:32.419354152 +0000 UTC m=+476.126320471" Jun 02 01:18:34.405227 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:34.405199 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" event={"ID":"92973bee-17e5-4759-934a-1769275a9929","Type":"ContainerStarted","Data":"22ee5feb2219335d0cb8209d11a1b4d25794cdedb2219a0db100e261c2abb35b"} Jun 02 01:18:34.405564 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:34.405356 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:34.435220 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:34.435175 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" podStartSLOduration=1.367020952 podStartE2EDuration="3.43516333s" podCreationTimestamp="2026-06-02 01:18:31 +0000 UTC" firstStartedPulling="2026-06-02 01:18:32.233328971 +0000 UTC m=+475.940295269" lastFinishedPulling="2026-06-02 01:18:34.301471348 +0000 UTC m=+478.008437647" observedRunningTime="2026-06-02 01:18:34.432406507 +0000 UTC m=+478.139372826" watchObservedRunningTime="2026-06-02 01:18:34.43516333 +0000 UTC m=+478.142129649" Jun 02 01:18:36.375186 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:36.375156 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kbw8b" Jun 02 01:18:43.402285 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:43.402255 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:45.073108 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.073073 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4"] Jun 02 01:18:45.073450 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.073297 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" containerName="manager" containerID="cri-o://422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae" gracePeriod=2 Jun 02 01:18:45.078230 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.078196 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4"] Jun 02 01:18:45.095104 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.095076 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:18:45.095658 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.095637 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" containerName="manager" Jun 02 01:18:45.095731 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.095665 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" containerName="manager" Jun 02 01:18:45.095777 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.095766 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" containerName="manager" Jun 02 01:18:45.099180 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.099160 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.101582 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.101554 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:45.111473 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.111450 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:18:45.267718 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.267685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78hjt\" (UniqueName: \"kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.267848 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.267731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.315602 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.315580 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:45.317852 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.317828 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:45.369092 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.369016 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78hjt\" (UniqueName: \"kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.369092 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.369060 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.369454 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.369435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.377327 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.377306 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78hjt\" (UniqueName: \"kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-bl5px\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.411067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.411045 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-z9tzr" Jun 02 01:18:45.441792 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.441765 2574 generic.go:358] "Generic (PLEG): container finished" podID="5f311a2d-f744-4437-8465-fa9c9f190d4a" containerID="422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae" exitCode=0 Jun 02 01:18:45.441879 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.441808 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" Jun 02 01:18:45.441879 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.441829 2574 scope.go:117] "RemoveContainer" containerID="422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae" Jun 02 01:18:45.445376 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.445347 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:45.447880 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.447850 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:45.450040 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.450024 2574 scope.go:117] "RemoveContainer" containerID="422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae" Jun 02 01:18:45.450279 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:18:45.450261 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae\": container with ID starting with 422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae not found: ID does not exist" containerID="422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae" Jun 02 01:18:45.450322 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.450296 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae"} err="failed to get container status \"422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae\": rpc error: code = NotFound desc = could not find container \"422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae\": container with ID starting with 422ae4f864b5d2a7451c48926bb37c16c24b5ed2085c4c2cf8f742f38164b3ae not found: ID does not exist" Jun 02 01:18:45.455405 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.455389 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:45.470138 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.470111 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqnjx\" (UniqueName: \"kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx\") pod \"5f311a2d-f744-4437-8465-fa9c9f190d4a\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " Jun 02 01:18:45.470237 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.470187 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume\") pod \"5f311a2d-f744-4437-8465-fa9c9f190d4a\" (UID: \"5f311a2d-f744-4437-8465-fa9c9f190d4a\") " Jun 02 01:18:45.470558 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.470533 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f311a2d-f744-4437-8465-fa9c9f190d4a" (UID: "5f311a2d-f744-4437-8465-fa9c9f190d4a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:45.472256 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.472220 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx" (OuterVolumeSpecName: "kube-api-access-lqnjx") pod "5f311a2d-f744-4437-8465-fa9c9f190d4a" (UID: "5f311a2d-f744-4437-8465-fa9c9f190d4a"). InnerVolumeSpecName "kube-api-access-lqnjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:45.571570 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.571540 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqnjx\" (UniqueName: \"kubernetes.io/projected/5f311a2d-f744-4437-8465-fa9c9f190d4a-kube-api-access-lqnjx\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:18:45.571570 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.571567 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f311a2d-f744-4437-8465-fa9c9f190d4a-extensions-socket-volume\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:18:45.588120 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.588097 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:18:45.590605 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:18:45.590581 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b92a6b_f9fc_4f5a_93e7_a301546188af.slice/crio-79298cb3e8acceb4cc58ec659026eae1c1f1fd81ceebd4f949686998b52074e8 WatchSource:0}: Error finding container 79298cb3e8acceb4cc58ec659026eae1c1f1fd81ceebd4f949686998b52074e8: Status 404 returned error can't find the container with id 79298cb3e8acceb4cc58ec659026eae1c1f1fd81ceebd4f949686998b52074e8 Jun 02 01:18:45.756167 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:45.756138 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:46.072532 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.072497 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz"] Jun 02 01:18:46.076073 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.076046 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.079411 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.079382 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:46.091215 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.091192 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz"] Jun 02 01:18:46.177227 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.177196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.177392 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.177232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffmm4\" (UniqueName: \"kubernetes.io/projected/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-kube-api-access-ffmm4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.278202 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.278169 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.278202 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.278205 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffmm4\" (UniqueName: \"kubernetes.io/projected/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-kube-api-access-ffmm4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.278535 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.278515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.290343 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.290315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffmm4\" (UniqueName: \"kubernetes.io/projected/b6208203-3fc1-4c2c-8cb2-118ce45a0de4-kube-api-access-ffmm4\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xn8kz\" (UID: \"b6208203-3fc1-4c2c-8cb2-118ce45a0de4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.385270 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.385204 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:46.448673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.448637 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" event={"ID":"d0b92a6b-f9fc-4f5a-93e7-a301546188af","Type":"ContainerStarted","Data":"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006"} Jun 02 01:18:46.448827 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.448684 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" event={"ID":"d0b92a6b-f9fc-4f5a-93e7-a301546188af","Type":"ContainerStarted","Data":"79298cb3e8acceb4cc58ec659026eae1c1f1fd81ceebd4f949686998b52074e8"} Jun 02 01:18:46.448827 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.448784 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:46.451056 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.451029 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:46.470296 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.470250 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" podStartSLOduration=1.470237886 podStartE2EDuration="1.470237886s" podCreationTimestamp="2026-06-02 01:18:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:18:46.46758376 +0000 UTC m=+490.174550080" watchObservedRunningTime="2026-06-02 01:18:46.470237886 +0000 UTC m=+490.177204246" Jun 02 01:18:46.520469 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.520446 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz"] Jun 02 01:18:46.522542 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:18:46.522510 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6208203_3fc1_4c2c_8cb2_118ce45a0de4.slice/crio-ced0623aceebe0a2f93520ef86a2c199f5a953592d4add9dd6eda53711ff37ef WatchSource:0}: Error finding container ced0623aceebe0a2f93520ef86a2c199f5a953592d4add9dd6eda53711ff37ef: Status 404 returned error can't find the container with id ced0623aceebe0a2f93520ef86a2c199f5a953592d4add9dd6eda53711ff37ef Jun 02 01:18:46.798013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.797980 2574 status_manager.go:895] "Failed to get status for pod" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7qnw4" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7qnw4\" is forbidden: User \"system:node:ip-10-0-139-243.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-243.ec2.internal' and this object" Jun 02 01:18:46.799311 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:46.799286 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f311a2d-f744-4437-8465-fa9c9f190d4a" path="/var/lib/kubelet/pods/5f311a2d-f744-4437-8465-fa9c9f190d4a/volumes" Jun 02 01:18:47.455171 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:47.455136 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" event={"ID":"b6208203-3fc1-4c2c-8cb2-118ce45a0de4","Type":"ContainerStarted","Data":"5e277b59cab88e9072359e14276eb9a11af0ae9c00305b7a927412e02a1e1a1b"} Jun 02 01:18:47.455171 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:47.455175 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" event={"ID":"b6208203-3fc1-4c2c-8cb2-118ce45a0de4","Type":"ContainerStarted","Data":"ced0623aceebe0a2f93520ef86a2c199f5a953592d4add9dd6eda53711ff37ef"} Jun 02 01:18:47.480571 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:47.480525 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" podStartSLOduration=1.480511222 podStartE2EDuration="1.480511222s" podCreationTimestamp="2026-06-02 01:18:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:18:47.480023625 +0000 UTC m=+491.186989942" watchObservedRunningTime="2026-06-02 01:18:47.480511222 +0000 UTC m=+491.187477540" Jun 02 01:18:48.458347 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:48.458314 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:57.457316 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:57.457285 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:59.463579 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.463554 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xn8kz" Jun 02 01:18:59.511857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.511825 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:18:59.512090 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.512063 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" podUID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" containerName="manager" containerID="cri-o://27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006" gracePeriod=10 Jun 02 01:18:59.761467 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.761444 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:18:59.784422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.784396 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume\") pod \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " Jun 02 01:18:59.784559 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.784504 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78hjt\" (UniqueName: \"kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt\") pod \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\" (UID: \"d0b92a6b-f9fc-4f5a-93e7-a301546188af\") " Jun 02 01:18:59.784840 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.784814 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d0b92a6b-f9fc-4f5a-93e7-a301546188af" (UID: "d0b92a6b-f9fc-4f5a-93e7-a301546188af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:18:59.786790 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.786761 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt" (OuterVolumeSpecName: "kube-api-access-78hjt") pod "d0b92a6b-f9fc-4f5a-93e7-a301546188af" (UID: "d0b92a6b-f9fc-4f5a-93e7-a301546188af"). InnerVolumeSpecName "kube-api-access-78hjt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:18:59.885265 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.885234 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0b92a6b-f9fc-4f5a-93e7-a301546188af-extensions-socket-volume\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:18:59.885265 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:18:59.885265 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78hjt\" (UniqueName: \"kubernetes.io/projected/d0b92a6b-f9fc-4f5a-93e7-a301546188af-kube-api-access-78hjt\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:19:00.505103 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.505068 2574 generic.go:358] "Generic (PLEG): container finished" podID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" containerID="27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006" exitCode=0 Jun 02 01:19:00.505466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.505133 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" Jun 02 01:19:00.505466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.505158 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" event={"ID":"d0b92a6b-f9fc-4f5a-93e7-a301546188af","Type":"ContainerDied","Data":"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006"} Jun 02 01:19:00.505466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.505196 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px" event={"ID":"d0b92a6b-f9fc-4f5a-93e7-a301546188af","Type":"ContainerDied","Data":"79298cb3e8acceb4cc58ec659026eae1c1f1fd81ceebd4f949686998b52074e8"} Jun 02 01:19:00.505466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.505209 2574 scope.go:117] "RemoveContainer" containerID="27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006" Jun 02 01:19:00.513896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.513687 2574 scope.go:117] "RemoveContainer" containerID="27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006" Jun 02 01:19:00.513951 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:19:00.513923 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006\": container with ID starting with 27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006 not found: ID does not exist" containerID="27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006" Jun 02 01:19:00.514057 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.513947 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006"} err="failed to get container status \"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006\": rpc error: code = NotFound desc = could not find container \"27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006\": container with ID starting with 27055e3e9bf63de00938a0876591fc5c777a8f76c66b3511846d5e13fc86f006 not found: ID does not exist" Jun 02 01:19:00.527011 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.526989 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:19:00.534874 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.534847 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-bl5px"] Jun 02 01:19:00.797219 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:00.797187 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" path="/var/lib/kubelet/pods/d0b92a6b-f9fc-4f5a-93e7-a301546188af/volumes" Jun 02 01:19:15.701314 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.701276 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp"] Jun 02 01:19:15.701858 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.701803 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" containerName="manager" Jun 02 01:19:15.701858 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.701825 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" containerName="manager" Jun 02 01:19:15.702003 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.701919 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0b92a6b-f9fc-4f5a-93e7-a301546188af" containerName="manager" Jun 02 01:19:15.704841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.704820 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.708417 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.708038 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-v9lgc\"" Jun 02 01:19:15.718536 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.717978 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp"] Jun 02 01:19:15.818726 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818695 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.818896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.818896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818754 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.818896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.818896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.818896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.819201 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.819201 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.818987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.819201 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.819078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv8bq\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-kube-api-access-xv8bq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919677 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919645 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919677 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919697 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919857 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919828 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919953 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919859 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919953 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919882 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.919953 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.919933 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920011 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xv8bq\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-kube-api-access-xv8bq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920091 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920242 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920221 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920344 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.920525 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.920442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.922249 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.922224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.922499 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.922483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.927258 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.927234 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:15.927430 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:15.927413 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv8bq\" (UniqueName: \"kubernetes.io/projected/ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0-kube-api-access-xv8bq\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-d66mp\" (UID: \"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:16.023637 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.023560 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:16.157497 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.157466 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp"] Jun 02 01:19:16.159860 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:19:16.159832 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3d39a0_0ecd_4012_9b2c_13dc2a7cc6b0.slice/crio-abedff00b0a23b5bcb81b690fbef310606a4ccbdd61f0e7eb04eca63534f4138 WatchSource:0}: Error finding container abedff00b0a23b5bcb81b690fbef310606a4ccbdd61f0e7eb04eca63534f4138: Status 404 returned error can't find the container with id abedff00b0a23b5bcb81b690fbef310606a4ccbdd61f0e7eb04eca63534f4138 Jun 02 01:19:16.162229 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.162190 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:19:16.162320 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.162275 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:19:16.162396 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.162316 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 01:19:16.561253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.561217 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" event={"ID":"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0","Type":"ContainerStarted","Data":"25f88c33f9f1ec4924130dc23f98a085b6081ed1a6f7f3b423629ec504bf2564"} Jun 02 01:19:16.561419 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.561260 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" event={"ID":"ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0","Type":"ContainerStarted","Data":"abedff00b0a23b5bcb81b690fbef310606a4ccbdd61f0e7eb04eca63534f4138"} Jun 02 01:19:16.580879 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:16.580832 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" podStartSLOduration=1.580817858 podStartE2EDuration="1.580817858s" podCreationTimestamp="2026-06-02 01:19:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:19:16.578708626 +0000 UTC m=+520.285674942" watchObservedRunningTime="2026-06-02 01:19:16.580817858 +0000 UTC m=+520.287784177" Jun 02 01:19:17.024795 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:17.024718 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:17.029231 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:17.029208 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:17.564590 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:17.564562 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:17.565729 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:17.565713 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-d66mp" Jun 02 01:19:19.850904 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.850870 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:19.854269 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.854251 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:19.857013 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.856990 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zd7mt\"" Jun 02 01:19:19.857125 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.857044 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 01:19:19.861548 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.861527 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:19.953284 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.953250 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:19.958490 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.958464 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:19.958651 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:19.958627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq469\" (UniqueName: \"kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.060110 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.060043 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rq469\" (UniqueName: \"kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.060279 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.060146 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.061752 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.061693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.071783 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.071758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq469\" (UniqueName: \"kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469\") pod \"limitador-limitador-7d549b5b-gc66x\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.165866 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.165800 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:20.300162 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.300140 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:20.302252 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:19:20.302221 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de7e9cc_d521_4500_b269_e44edcc065c1.slice/crio-78dcc5c517d9614597b3823ccf34c95edab65557c2e557372fec601bae5ad238 WatchSource:0}: Error finding container 78dcc5c517d9614597b3823ccf34c95edab65557c2e557372fec601bae5ad238: Status 404 returned error can't find the container with id 78dcc5c517d9614597b3823ccf34c95edab65557c2e557372fec601bae5ad238 Jun 02 01:19:20.575997 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:20.575945 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" event={"ID":"0de7e9cc-d521-4500-b269-e44edcc065c1","Type":"ContainerStarted","Data":"78dcc5c517d9614597b3823ccf34c95edab65557c2e557372fec601bae5ad238"} Jun 02 01:19:23.589781 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:23.589743 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" event={"ID":"0de7e9cc-d521-4500-b269-e44edcc065c1","Type":"ContainerStarted","Data":"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac"} Jun 02 01:19:23.590244 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:23.589894 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:23.609711 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:23.609670 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" podStartSLOduration=2.145985399 podStartE2EDuration="4.60965603s" podCreationTimestamp="2026-06-02 01:19:19 +0000 UTC" firstStartedPulling="2026-06-02 01:19:20.304111611 +0000 UTC m=+524.011077908" lastFinishedPulling="2026-06-02 01:19:22.767782241 +0000 UTC m=+526.474748539" observedRunningTime="2026-06-02 01:19:23.607245866 +0000 UTC m=+527.314212185" watchObservedRunningTime="2026-06-02 01:19:23.60965603 +0000 UTC m=+527.316622351" Jun 02 01:19:34.594358 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:34.594326 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:34.625913 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:34.625883 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:34.630073 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:34.630042 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" podUID="0de7e9cc-d521-4500-b269-e44edcc065c1" containerName="limitador" containerID="cri-o://2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac" gracePeriod=30 Jun 02 01:19:35.173819 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.173794 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:35.295703 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.295671 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rq469\" (UniqueName: \"kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469\") pod \"0de7e9cc-d521-4500-b269-e44edcc065c1\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " Jun 02 01:19:35.295878 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.295760 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file\") pod \"0de7e9cc-d521-4500-b269-e44edcc065c1\" (UID: \"0de7e9cc-d521-4500-b269-e44edcc065c1\") " Jun 02 01:19:35.296167 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.296140 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file" (OuterVolumeSpecName: "config-file") pod "0de7e9cc-d521-4500-b269-e44edcc065c1" (UID: "0de7e9cc-d521-4500-b269-e44edcc065c1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:19:35.298339 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.298296 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469" (OuterVolumeSpecName: "kube-api-access-rq469") pod "0de7e9cc-d521-4500-b269-e44edcc065c1" (UID: "0de7e9cc-d521-4500-b269-e44edcc065c1"). InnerVolumeSpecName "kube-api-access-rq469". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:19:35.396821 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.396788 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rq469\" (UniqueName: \"kubernetes.io/projected/0de7e9cc-d521-4500-b269-e44edcc065c1-kube-api-access-rq469\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:19:35.396821 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.396817 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0de7e9cc-d521-4500-b269-e44edcc065c1-config-file\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:19:35.634075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.633990 2574 generic.go:358] "Generic (PLEG): container finished" podID="0de7e9cc-d521-4500-b269-e44edcc065c1" containerID="2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac" exitCode=0 Jun 02 01:19:35.634075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.634038 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" event={"ID":"0de7e9cc-d521-4500-b269-e44edcc065c1","Type":"ContainerDied","Data":"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac"} Jun 02 01:19:35.634075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.634057 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" Jun 02 01:19:35.634624 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.634080 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-gc66x" event={"ID":"0de7e9cc-d521-4500-b269-e44edcc065c1","Type":"ContainerDied","Data":"78dcc5c517d9614597b3823ccf34c95edab65557c2e557372fec601bae5ad238"} Jun 02 01:19:35.634624 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.634115 2574 scope.go:117] "RemoveContainer" containerID="2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac" Jun 02 01:19:35.642090 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.642069 2574 scope.go:117] "RemoveContainer" containerID="2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac" Jun 02 01:19:35.642333 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:19:35.642315 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac\": container with ID starting with 2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac not found: ID does not exist" containerID="2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac" Jun 02 01:19:35.642385 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.642342 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac"} err="failed to get container status \"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac\": rpc error: code = NotFound desc = could not find container \"2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac\": container with ID starting with 2ab4c7332b960ac9918e17a3d8b71f3cffa21cf26700dd7911256d8f9c65e5ac not found: ID does not exist" Jun 02 01:19:35.654600 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.654578 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:35.657566 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.657545 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-gc66x"] Jun 02 01:19:35.816191 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.816160 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f7ksb"] Jun 02 01:19:35.816512 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.816500 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0de7e9cc-d521-4500-b269-e44edcc065c1" containerName="limitador" Jun 02 01:19:35.816570 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.816514 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="0de7e9cc-d521-4500-b269-e44edcc065c1" containerName="limitador" Jun 02 01:19:35.816604 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.816589 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="0de7e9cc-d521-4500-b269-e44edcc065c1" containerName="limitador" Jun 02 01:19:35.821136 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.821114 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:35.823691 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.823666 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 01:19:35.826502 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.826473 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f7ksb"] Jun 02 01:19:35.901618 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.901549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-298l6\" (UniqueName: \"kubernetes.io/projected/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-kube-api-access-298l6\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:35.901808 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:35.901792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-data\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.002709 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.002678 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-data\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.002859 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.002734 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-298l6\" (UniqueName: \"kubernetes.io/projected/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-kube-api-access-298l6\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.003095 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.003077 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-data\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.011299 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.011282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-298l6\" (UniqueName: \"kubernetes.io/projected/f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a-kube-api-access-298l6\") pod \"postgres-68c4fbbd6f-f7ksb\" (UID: \"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a\") " pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.134850 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.134816 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:36.259640 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.259617 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-f7ksb"] Jun 02 01:19:36.261612 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:19:36.261584 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf622a31a_ed04_4da5_abbd_d2ce9a8d9f3a.slice/crio-c7fd030358ded7e292baf65fcc729b3174eb46460639df3842de912c4b261246 WatchSource:0}: Error finding container c7fd030358ded7e292baf65fcc729b3174eb46460639df3842de912c4b261246: Status 404 returned error can't find the container with id c7fd030358ded7e292baf65fcc729b3174eb46460639df3842de912c4b261246 Jun 02 01:19:36.638109 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.638069 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" event={"ID":"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a","Type":"ContainerStarted","Data":"c7fd030358ded7e292baf65fcc729b3174eb46460639df3842de912c4b261246"} Jun 02 01:19:36.799295 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:36.799259 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0de7e9cc-d521-4500-b269-e44edcc065c1" path="/var/lib/kubelet/pods/0de7e9cc-d521-4500-b269-e44edcc065c1/volumes" Jun 02 01:19:38.219492 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:38.219471 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 01:19:38.647526 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:38.647492 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" event={"ID":"f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a","Type":"ContainerStarted","Data":"0cb5349aa7b1ebf739f2200a927ea1931c515b21562f32157ee6a64af2c529de"} Jun 02 01:19:38.647681 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:38.647595 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:19:38.663938 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:38.663894 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" podStartSLOduration=1.710241049 podStartE2EDuration="3.663883691s" podCreationTimestamp="2026-06-02 01:19:35 +0000 UTC" firstStartedPulling="2026-06-02 01:19:36.263029777 +0000 UTC m=+539.969996074" lastFinishedPulling="2026-06-02 01:19:38.216672404 +0000 UTC m=+541.923638716" observedRunningTime="2026-06-02 01:19:38.662514447 +0000 UTC m=+542.369480764" watchObservedRunningTime="2026-06-02 01:19:38.663883691 +0000 UTC m=+542.370850009" Jun 02 01:19:44.680890 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:19:44.680861 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-f7ksb" Jun 02 01:20:08.177845 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.177809 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:20:08.180069 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.180053 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:08.182622 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.182595 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lnxhj\"" Jun 02 01:20:08.182741 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.182597 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 01:20:08.183891 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.183873 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:20:08.184004 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.183876 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:20:08.188358 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.188335 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:20:08.289347 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.289300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrh8\" (UniqueName: \"kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8\") pod \"maas-keycloak-0\" (UID: \"6259c7b4-958c-4964-881b-77335932c0b3\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:08.390606 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.390568 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrh8\" (UniqueName: \"kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8\") pod \"maas-keycloak-0\" (UID: \"6259c7b4-958c-4964-881b-77335932c0b3\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:08.399043 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.399014 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrh8\" (UniqueName: \"kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8\") pod \"maas-keycloak-0\" (UID: \"6259c7b4-958c-4964-881b-77335932c0b3\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:08.490533 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.490450 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:08.619383 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.619344 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:20:08.756537 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:08.756448 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6259c7b4-958c-4964-881b-77335932c0b3","Type":"ContainerStarted","Data":"d9537e95a33afa5415e91d3d8cb92bd14b4d33580b9f7571aed191ae0bbbd4cb"} Jun 02 01:20:13.778604 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:13.778570 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6259c7b4-958c-4964-881b-77335932c0b3","Type":"ContainerStarted","Data":"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01"} Jun 02 01:20:13.795953 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:13.795888 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.427961128 podStartE2EDuration="5.795867823s" podCreationTimestamp="2026-06-02 01:20:08 +0000 UTC" firstStartedPulling="2026-06-02 01:20:08.624356456 +0000 UTC m=+572.331322753" lastFinishedPulling="2026-06-02 01:20:12.992263148 +0000 UTC m=+576.699229448" observedRunningTime="2026-06-02 01:20:13.794376432 +0000 UTC m=+577.501342752" watchObservedRunningTime="2026-06-02 01:20:13.795867823 +0000 UTC m=+577.502834141" Jun 02 01:20:14.491253 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:14.491202 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:14.493302 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:14.493260 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:15.491521 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:15.491451 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:16.491227 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:16.491174 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:17.490888 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:17.490845 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:18.490771 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:18.490730 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:18.492146 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:18.492105 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:19.491179 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:19.491128 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:20.491036 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:20.490988 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:21.491377 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:21.491333 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:22.491345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:22.491289 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:23.491767 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:23.491717 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:24.490898 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:24.490841 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:25.491121 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:25.491071 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.36:9000/health/started\": dial tcp 10.132.0.36:9000: connect: connection refused" Jun 02 01:20:26.588673 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:26.588622 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:26.602928 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:26.602665 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:20:36.595289 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:36.595244 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:20:36.780404 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:36.780378 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:20:36.780805 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:36.780782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:20:42.692635 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.692586 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:42.703456 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.703429 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:42.708117 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.708068 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:42.708386 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.708319 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bv8kz\"" Jun 02 01:20:42.708600 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.708568 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 01:20:42.833807 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.833765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lj78\" (UniqueName: \"kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78\") pod \"maas-controller-67fcd77c46-hkq28\" (UID: \"acee3765-8091-4c22-8645-a23a767a143b\") " pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:42.860576 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.860527 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-769fd65d94-8lspd"] Jun 02 01:20:42.864203 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.864177 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:42.872448 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.872417 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-769fd65d94-8lspd"] Jun 02 01:20:42.935193 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.935153 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8jbv\" (UniqueName: \"kubernetes.io/projected/3f24b764-8223-4241-b943-ddf7d37ac465-kube-api-access-k8jbv\") pod \"maas-controller-769fd65d94-8lspd\" (UID: \"3f24b764-8223-4241-b943-ddf7d37ac465\") " pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:42.935387 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.935246 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4lj78\" (UniqueName: \"kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78\") pod \"maas-controller-67fcd77c46-hkq28\" (UID: \"acee3765-8091-4c22-8645-a23a767a143b\") " pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:42.943911 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:42.943857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lj78\" (UniqueName: \"kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78\") pod \"maas-controller-67fcd77c46-hkq28\" (UID: \"acee3765-8091-4c22-8645-a23a767a143b\") " pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:43.021483 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.021448 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:43.036782 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.036754 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k8jbv\" (UniqueName: \"kubernetes.io/projected/3f24b764-8223-4241-b943-ddf7d37ac465-kube-api-access-k8jbv\") pod \"maas-controller-769fd65d94-8lspd\" (UID: \"3f24b764-8223-4241-b943-ddf7d37ac465\") " pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:43.049474 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.049448 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8jbv\" (UniqueName: \"kubernetes.io/projected/3f24b764-8223-4241-b943-ddf7d37ac465-kube-api-access-k8jbv\") pod \"maas-controller-769fd65d94-8lspd\" (UID: \"3f24b764-8223-4241-b943-ddf7d37ac465\") " pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:43.151237 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.151208 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:43.153807 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:20:43.153783 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacee3765_8091_4c22_8645_a23a767a143b.slice/crio-8689398bc028b69e611551ec7890ec8ea94149c6e0a4c36a1d15d612118c3e1a WatchSource:0}: Error finding container 8689398bc028b69e611551ec7890ec8ea94149c6e0a4c36a1d15d612118c3e1a: Status 404 returned error can't find the container with id 8689398bc028b69e611551ec7890ec8ea94149c6e0a4c36a1d15d612118c3e1a Jun 02 01:20:43.177209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.177187 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:43.301791 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.301713 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-769fd65d94-8lspd"] Jun 02 01:20:43.304063 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:20:43.304030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f24b764_8223_4241_b943_ddf7d37ac465.slice/crio-13b4211c779a231af86ca747af1f7ec850d2dc9782aef6dc84342c4388d60ef9 WatchSource:0}: Error finding container 13b4211c779a231af86ca747af1f7ec850d2dc9782aef6dc84342c4388d60ef9: Status 404 returned error can't find the container with id 13b4211c779a231af86ca747af1f7ec850d2dc9782aef6dc84342c4388d60ef9 Jun 02 01:20:43.899119 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.899081 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fcd77c46-hkq28" event={"ID":"acee3765-8091-4c22-8645-a23a767a143b","Type":"ContainerStarted","Data":"8689398bc028b69e611551ec7890ec8ea94149c6e0a4c36a1d15d612118c3e1a"} Jun 02 01:20:43.900896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:43.900862 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-769fd65d94-8lspd" event={"ID":"3f24b764-8223-4241-b943-ddf7d37ac465","Type":"ContainerStarted","Data":"13b4211c779a231af86ca747af1f7ec850d2dc9782aef6dc84342c4388d60ef9"} Jun 02 01:20:45.910030 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.909995 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-769fd65d94-8lspd" event={"ID":"3f24b764-8223-4241-b943-ddf7d37ac465","Type":"ContainerStarted","Data":"babcc1ee913ace665dec4df102a9d91bbaabdd3fedace51be9ce2ec5a38bc146"} Jun 02 01:20:45.910447 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.910105 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:45.911400 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.911375 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fcd77c46-hkq28" event={"ID":"acee3765-8091-4c22-8645-a23a767a143b","Type":"ContainerStarted","Data":"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415"} Jun 02 01:20:45.911526 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.911489 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:45.933178 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.933138 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-769fd65d94-8lspd" podStartSLOduration=1.518915652 podStartE2EDuration="3.933126302s" podCreationTimestamp="2026-06-02 01:20:42 +0000 UTC" firstStartedPulling="2026-06-02 01:20:43.305430865 +0000 UTC m=+607.012397163" lastFinishedPulling="2026-06-02 01:20:45.719641509 +0000 UTC m=+609.426607813" observedRunningTime="2026-06-02 01:20:45.931566552 +0000 UTC m=+609.638532886" watchObservedRunningTime="2026-06-02 01:20:45.933126302 +0000 UTC m=+609.640092614" Jun 02 01:20:45.951831 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:45.951744 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-67fcd77c46-hkq28" podStartSLOduration=1.39731257 podStartE2EDuration="3.951731523s" podCreationTimestamp="2026-06-02 01:20:42 +0000 UTC" firstStartedPulling="2026-06-02 01:20:43.155042445 +0000 UTC m=+606.862008741" lastFinishedPulling="2026-06-02 01:20:45.709461387 +0000 UTC m=+609.416427694" observedRunningTime="2026-06-02 01:20:45.949919779 +0000 UTC m=+609.656886099" watchObservedRunningTime="2026-06-02 01:20:45.951731523 +0000 UTC m=+609.658697843" Jun 02 01:20:56.921119 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:56.921085 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:56.921638 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:56.921152 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-769fd65d94-8lspd" Jun 02 01:20:56.987499 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:56.987468 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:56.987661 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:56.987642 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-67fcd77c46-hkq28" podUID="acee3765-8091-4c22-8645-a23a767a143b" containerName="manager" containerID="cri-o://d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415" gracePeriod=30 Jun 02 01:20:57.232803 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.232780 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:57.364341 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.364313 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lj78\" (UniqueName: \"kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78\") pod \"acee3765-8091-4c22-8645-a23a767a143b\" (UID: \"acee3765-8091-4c22-8645-a23a767a143b\") " Jun 02 01:20:57.366390 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.366368 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78" (OuterVolumeSpecName: "kube-api-access-4lj78") pod "acee3765-8091-4c22-8645-a23a767a143b" (UID: "acee3765-8091-4c22-8645-a23a767a143b"). InnerVolumeSpecName "kube-api-access-4lj78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:20:57.465511 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.465446 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lj78\" (UniqueName: \"kubernetes.io/projected/acee3765-8091-4c22-8645-a23a767a143b-kube-api-access-4lj78\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:20:57.950943 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.950907 2574 generic.go:358] "Generic (PLEG): container finished" podID="acee3765-8091-4c22-8645-a23a767a143b" containerID="d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415" exitCode=0 Jun 02 01:20:57.951345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.950958 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fcd77c46-hkq28" event={"ID":"acee3765-8091-4c22-8645-a23a767a143b","Type":"ContainerDied","Data":"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415"} Jun 02 01:20:57.951345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.950994 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67fcd77c46-hkq28" Jun 02 01:20:57.951345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.951018 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67fcd77c46-hkq28" event={"ID":"acee3765-8091-4c22-8645-a23a767a143b","Type":"ContainerDied","Data":"8689398bc028b69e611551ec7890ec8ea94149c6e0a4c36a1d15d612118c3e1a"} Jun 02 01:20:57.951345 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.951039 2574 scope.go:117] "RemoveContainer" containerID="d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415" Jun 02 01:20:57.959366 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.959343 2574 scope.go:117] "RemoveContainer" containerID="d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415" Jun 02 01:20:57.959616 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:20:57.959597 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415\": container with ID starting with d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415 not found: ID does not exist" containerID="d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415" Jun 02 01:20:57.959675 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.959624 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415"} err="failed to get container status \"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415\": rpc error: code = NotFound desc = could not find container \"d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415\": container with ID starting with d69e20e9e483d8d32291e51626f656bde62d3ca084326d7f2ae26df5e2d45415 not found: ID does not exist" Jun 02 01:20:57.971816 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.971789 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:57.974336 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:57.974318 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67fcd77c46-hkq28"] Jun 02 01:20:58.797783 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:20:58.797751 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acee3765-8091-4c22-8645-a23a767a143b" path="/var/lib/kubelet/pods/acee3765-8091-4c22-8645-a23a767a143b/volumes" Jun 02 01:21:16.180665 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.180632 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-658bb9d9dd-zpmtn"] Jun 02 01:21:16.183290 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.181101 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acee3765-8091-4c22-8645-a23a767a143b" containerName="manager" Jun 02 01:21:16.183290 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.181115 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="acee3765-8091-4c22-8645-a23a767a143b" containerName="manager" Jun 02 01:21:16.183290 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.181185 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="acee3765-8091-4c22-8645-a23a767a143b" containerName="manager" Jun 02 01:21:16.184098 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.184083 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.186640 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.186612 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 01:21:16.186766 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.186705 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lgsrr\"" Jun 02 01:21:16.194176 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.194155 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-658bb9d9dd-zpmtn"] Jun 02 01:21:16.235852 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.235816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.236027 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.235891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmt6\" (UniqueName: \"kubernetes.io/projected/2f523549-75f2-4b96-9468-5b4b333e61eb-kube-api-access-pcmt6\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.337332 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.337298 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.337506 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.337376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmt6\" (UniqueName: \"kubernetes.io/projected/2f523549-75f2-4b96-9468-5b4b333e61eb-kube-api-access-pcmt6\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.337506 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:21:16.337453 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 01:21:16.337589 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:21:16.337532 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls podName:2f523549-75f2-4b96-9468-5b4b333e61eb nodeName:}" failed. No retries permitted until 2026-06-02 01:21:16.837512669 +0000 UTC m=+640.544478977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls") pod "maas-api-658bb9d9dd-zpmtn" (UID: "2f523549-75f2-4b96-9468-5b4b333e61eb") : secret "maas-api-serving-cert" not found Jun 02 01:21:16.346579 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.346552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmt6\" (UniqueName: \"kubernetes.io/projected/2f523549-75f2-4b96-9468-5b4b333e61eb-kube-api-access-pcmt6\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.730514 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.730479 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fr2ng"] Jun 02 01:21:16.734173 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.734157 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:16.737555 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.737534 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 02 01:21:16.757203 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.757173 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fr2ng"] Jun 02 01:21:16.842241 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.842205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz9xm\" (UniqueName: \"kubernetes.io/projected/37633866-f188-4b96-8a0f-5a5e7b057963-kube-api-access-gz9xm\") pod \"payload-processing-58b6c8fdc7-fr2ng\" (UID: \"37633866-f188-4b96-8a0f-5a5e7b057963\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:16.842422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.842294 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:16.842422 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:21:16.842408 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 02 01:21:16.842575 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:21:16.842473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls podName:2f523549-75f2-4b96-9468-5b4b333e61eb nodeName:}" failed. No retries permitted until 2026-06-02 01:21:17.842455283 +0000 UTC m=+641.549421579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls") pod "maas-api-658bb9d9dd-zpmtn" (UID: "2f523549-75f2-4b96-9468-5b4b333e61eb") : secret "maas-api-serving-cert" not found Jun 02 01:21:16.943930 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.943902 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gz9xm\" (UniqueName: \"kubernetes.io/projected/37633866-f188-4b96-8a0f-5a5e7b057963-kube-api-access-gz9xm\") pod \"payload-processing-58b6c8fdc7-fr2ng\" (UID: \"37633866-f188-4b96-8a0f-5a5e7b057963\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:16.955731 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:16.955696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz9xm\" (UniqueName: \"kubernetes.io/projected/37633866-f188-4b96-8a0f-5a5e7b057963-kube-api-access-gz9xm\") pod \"payload-processing-58b6c8fdc7-fr2ng\" (UID: \"37633866-f188-4b96-8a0f-5a5e7b057963\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:17.044734 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:17.044699 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:17.190552 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:17.190516 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-fr2ng"] Jun 02 01:21:17.193477 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:21:17.193449 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37633866_f188_4b96_8a0f_5a5e7b057963.slice/crio-639b61ac2fa0df7fbda9cc33fc0ee4cf6e55bb06b42dd365c633c924ab0b58d0 WatchSource:0}: Error finding container 639b61ac2fa0df7fbda9cc33fc0ee4cf6e55bb06b42dd365c633c924ab0b58d0: Status 404 returned error can't find the container with id 639b61ac2fa0df7fbda9cc33fc0ee4cf6e55bb06b42dd365c633c924ab0b58d0 Jun 02 01:21:17.861118 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:17.860464 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:17.868265 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:17.864044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f523549-75f2-4b96-9468-5b4b333e61eb-maas-api-tls\") pod \"maas-api-658bb9d9dd-zpmtn\" (UID: \"2f523549-75f2-4b96-9468-5b4b333e61eb\") " pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:17.995787 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:17.995749 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:18.027402 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:18.027370 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" event={"ID":"37633866-f188-4b96-8a0f-5a5e7b057963","Type":"ContainerStarted","Data":"639b61ac2fa0df7fbda9cc33fc0ee4cf6e55bb06b42dd365c633c924ab0b58d0"} Jun 02 01:21:18.196704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:18.196630 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-658bb9d9dd-zpmtn"] Jun 02 01:21:18.487753 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:21:18.487683 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f523549_75f2_4b96_9468_5b4b333e61eb.slice/crio-dcedbf432f5e5adaa702afd1f836bcc1cc9219787c34bb8a10ec69d5464f1900 WatchSource:0}: Error finding container dcedbf432f5e5adaa702afd1f836bcc1cc9219787c34bb8a10ec69d5464f1900: Status 404 returned error can't find the container with id dcedbf432f5e5adaa702afd1f836bcc1cc9219787c34bb8a10ec69d5464f1900 Jun 02 01:21:19.032940 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:19.032903 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" event={"ID":"2f523549-75f2-4b96-9468-5b4b333e61eb","Type":"ContainerStarted","Data":"dcedbf432f5e5adaa702afd1f836bcc1cc9219787c34bb8a10ec69d5464f1900"} Jun 02 01:21:19.034266 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:19.034243 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" event={"ID":"37633866-f188-4b96-8a0f-5a5e7b057963","Type":"ContainerStarted","Data":"4097630c5a3b87edf1b035ac12d16282e6c90e4bf9c9958cc3cf141b761adb20"} Jun 02 01:21:19.034526 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:19.034291 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:19.062392 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:19.056166 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" podStartSLOduration=1.716770836 podStartE2EDuration="3.056148265s" podCreationTimestamp="2026-06-02 01:21:16 +0000 UTC" firstStartedPulling="2026-06-02 01:21:17.195403852 +0000 UTC m=+640.902370149" lastFinishedPulling="2026-06-02 01:21:18.534781279 +0000 UTC m=+642.241747578" observedRunningTime="2026-06-02 01:21:19.055592885 +0000 UTC m=+642.762559205" watchObservedRunningTime="2026-06-02 01:21:19.056148265 +0000 UTC m=+642.763114595" Jun 02 01:21:21.043392 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:21.043355 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" event={"ID":"2f523549-75f2-4b96-9468-5b4b333e61eb","Type":"ContainerStarted","Data":"b17ba4892c75eac822497aa240a1c12e62e7e4a267ec2f242f9f2f83e152979c"} Jun 02 01:21:21.043794 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:21.043469 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:21.065909 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:21.065860 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" podStartSLOduration=3.351206252 podStartE2EDuration="5.065847549s" podCreationTimestamp="2026-06-02 01:21:16 +0000 UTC" firstStartedPulling="2026-06-02 01:21:18.489084754 +0000 UTC m=+642.196051051" lastFinishedPulling="2026-06-02 01:21:20.203726038 +0000 UTC m=+643.910692348" observedRunningTime="2026-06-02 01:21:21.065664344 +0000 UTC m=+644.772630674" watchObservedRunningTime="2026-06-02 01:21:21.065847549 +0000 UTC m=+644.772813871" Jun 02 01:21:27.052154 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:27.052125 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-658bb9d9dd-zpmtn" Jun 02 01:21:28.770675 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:28.770630 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:28.771075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:28.770861 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" containerID="cri-o://4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01" gracePeriod=30 Jun 02 01:21:30.041134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:30.041102 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-fr2ng" Jun 02 01:21:30.816739 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:30.816715 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:30.883055 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:30.883023 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqrh8\" (UniqueName: \"kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8\") pod \"6259c7b4-958c-4964-881b-77335932c0b3\" (UID: \"6259c7b4-958c-4964-881b-77335932c0b3\") " Jun 02 01:21:30.885189 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:30.885163 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8" (OuterVolumeSpecName: "kube-api-access-xqrh8") pod "6259c7b4-958c-4964-881b-77335932c0b3" (UID: "6259c7b4-958c-4964-881b-77335932c0b3"). InnerVolumeSpecName "kube-api-access-xqrh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:21:30.984533 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:30.984436 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqrh8\" (UniqueName: \"kubernetes.io/projected/6259c7b4-958c-4964-881b-77335932c0b3-kube-api-access-xqrh8\") on node \"ip-10-0-139-243.ec2.internal\" DevicePath \"\"" Jun 02 01:21:31.090687 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.090644 2574 generic.go:358] "Generic (PLEG): container finished" podID="6259c7b4-958c-4964-881b-77335932c0b3" containerID="4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01" exitCode=143 Jun 02 01:21:31.091134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.090715 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.091134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.090750 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6259c7b4-958c-4964-881b-77335932c0b3","Type":"ContainerDied","Data":"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01"} Jun 02 01:21:31.091134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.090785 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6259c7b4-958c-4964-881b-77335932c0b3","Type":"ContainerDied","Data":"d9537e95a33afa5415e91d3d8cb92bd14b4d33580b9f7571aed191ae0bbbd4cb"} Jun 02 01:21:31.091134 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.090800 2574 scope.go:117] "RemoveContainer" containerID="4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01" Jun 02 01:21:31.100132 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.100112 2574 scope.go:117] "RemoveContainer" containerID="4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01" Jun 02 01:21:31.100387 ip-10-0-139-243 kubenswrapper[2574]: E0602 01:21:31.100368 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01\": container with ID starting with 4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01 not found: ID does not exist" containerID="4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01" Jun 02 01:21:31.100457 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.100393 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01"} err="failed to get container status \"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01\": rpc error: code = NotFound desc = could not find container \"4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01\": container with ID starting with 4f95d409d5678db4fd8443c09c7b5e9a08ddbe5c68008e09ea30d8455b4b7d01 not found: ID does not exist" Jun 02 01:21:31.111209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.111184 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:31.115010 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.114989 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:31.135850 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.135825 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:31.136350 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.136331 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" Jun 02 01:21:31.136350 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.136351 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" Jun 02 01:21:31.136477 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.136409 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="6259c7b4-958c-4964-881b-77335932c0b3" containerName="keycloak" Jun 02 01:21:31.140904 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.140888 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.143587 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.143566 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lnxhj\"" Jun 02 01:21:31.143708 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.143567 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 01:21:31.144089 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.143929 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 01:21:31.144089 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.143944 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 01:21:31.144258 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.144130 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 01:21:31.146938 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.146919 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:31.186719 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.186677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/40b11096-417d-4764-b170-46290fa0d19e-test-realms\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.186887 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.186780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m5vd\" (UniqueName: \"kubernetes.io/projected/40b11096-417d-4764-b170-46290fa0d19e-kube-api-access-6m5vd\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.288224 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.288191 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/40b11096-417d-4764-b170-46290fa0d19e-test-realms\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.288390 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.288241 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6m5vd\" (UniqueName: \"kubernetes.io/projected/40b11096-417d-4764-b170-46290fa0d19e-kube-api-access-6m5vd\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.288838 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.288819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/40b11096-417d-4764-b170-46290fa0d19e-test-realms\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.296865 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.296831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m5vd\" (UniqueName: \"kubernetes.io/projected/40b11096-417d-4764-b170-46290fa0d19e-kube-api-access-6m5vd\") pod \"maas-keycloak-0\" (UID: \"40b11096-417d-4764-b170-46290fa0d19e\") " pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.453896 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.453859 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:31.582983 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:31.582937 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 01:21:31.585035 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:21:31.584999 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b11096_417d_4764_b170_46290fa0d19e.slice/crio-1d257ad12d9d216578e57b3f07730be4e615986881d93f3cd557123a20c53cd7 WatchSource:0}: Error finding container 1d257ad12d9d216578e57b3f07730be4e615986881d93f3cd557123a20c53cd7: Status 404 returned error can't find the container with id 1d257ad12d9d216578e57b3f07730be4e615986881d93f3cd557123a20c53cd7 Jun 02 01:21:32.097190 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.097157 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"40b11096-417d-4764-b170-46290fa0d19e","Type":"ContainerStarted","Data":"be419487d46c5aceb92722d91e2d5e6255ead930f5400fcf00648c0bd2aa2092"} Jun 02 01:21:32.097190 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.097194 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"40b11096-417d-4764-b170-46290fa0d19e","Type":"ContainerStarted","Data":"1d257ad12d9d216578e57b3f07730be4e615986881d93f3cd557123a20c53cd7"} Jun 02 01:21:32.116927 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.116872 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.780462746 podStartE2EDuration="1.116855313s" podCreationTimestamp="2026-06-02 01:21:31 +0000 UTC" firstStartedPulling="2026-06-02 01:21:31.58634664 +0000 UTC m=+655.293312936" lastFinishedPulling="2026-06-02 01:21:31.922739206 +0000 UTC m=+655.629705503" observedRunningTime="2026-06-02 01:21:32.113996255 +0000 UTC m=+655.820962576" watchObservedRunningTime="2026-06-02 01:21:32.116855313 +0000 UTC m=+655.823821639" Jun 02 01:21:32.454417 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.454365 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:32.456126 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.456088 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:32.800820 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:32.800778 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6259c7b4-958c-4964-881b-77335932c0b3" path="/var/lib/kubelet/pods/6259c7b4-958c-4964-881b-77335932c0b3/volumes" Jun 02 01:21:33.455210 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:33.455161 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:34.455317 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:34.455262 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:35.455094 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:35.455040 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:36.454997 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:36.454929 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:37.454353 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:37.454300 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:38.455392 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:38.455335 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:39.454778 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:39.454718 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:40.454841 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:40.454797 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:41.454140 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:41.454091 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:41.454413 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:41.454380 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:42.454583 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:42.454526 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:43.454838 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:43.454779 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:44.455123 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:44.455075 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.41:9000/health/started\": dial tcp 10.132.0.41:9000: connect: connection refused" Jun 02 01:21:45.546581 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:45.546539 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 01:21:45.561785 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:45.561734 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:21:55.551211 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:21:55.551161 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="40b11096-417d-4764-b170-46290fa0d19e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 01:22:05.552912 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:05.552863 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 01:22:58.809224 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.809186 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp"] Jun 02 01:22:58.813185 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.813164 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.815793 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.815765 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 01:22:58.816723 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.816705 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 01:22:58.816723 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.816715 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xv875\"" Jun 02 01:22:58.816888 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.816717 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 01:22:58.821044 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.820934 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp"] Jun 02 01:22:58.902498 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902462 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.902704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8hbj\" (UniqueName: \"kubernetes.io/projected/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kube-api-access-l8hbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.902704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad1061c-6c0a-4df8-8033-d1947c7d1953-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.902704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.902704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:58.902704 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:58.902674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.003936 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.003901 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.003936 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.003937 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004217 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004076 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004217 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004161 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004217 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004199 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l8hbj\" (UniqueName: \"kubernetes.io/projected/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kube-api-access-l8hbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004375 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad1061c-6c0a-4df8-8033-d1947c7d1953-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004466 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004576 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.004699 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.004650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.006355 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.006334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ad1061c-6c0a-4df8-8033-d1947c7d1953-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.006697 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.006678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ad1061c-6c0a-4df8-8033-d1947c7d1953-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.012315 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.012293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8hbj\" (UniqueName: \"kubernetes.io/projected/7ad1061c-6c0a-4df8-8033-d1947c7d1953-kube-api-access-l8hbj\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp\" (UID: \"7ad1061c-6c0a-4df8-8033-d1947c7d1953\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.126086 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.125959 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:22:59.261812 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.261782 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp"] Jun 02 01:22:59.263912 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:22:59.263879 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad1061c_6c0a_4df8_8033_d1947c7d1953.slice/crio-7a2b177756d430020a06a74be4652d30dd4b56a2c7928e27686978932c0447c5 WatchSource:0}: Error finding container 7a2b177756d430020a06a74be4652d30dd4b56a2c7928e27686978932c0447c5: Status 404 returned error can't find the container with id 7a2b177756d430020a06a74be4652d30dd4b56a2c7928e27686978932c0447c5 Jun 02 01:22:59.265689 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.265674 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:22:59.436584 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:22:59.436485 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" event={"ID":"7ad1061c-6c0a-4df8-8033-d1947c7d1953","Type":"ContainerStarted","Data":"7a2b177756d430020a06a74be4652d30dd4b56a2c7928e27686978932c0447c5"} Jun 02 01:23:03.455920 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:03.455886 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" event={"ID":"7ad1061c-6c0a-4df8-8033-d1947c7d1953","Type":"ContainerStarted","Data":"27110c779cd9ad2daadc6d26d67580e20f2b06487bbbbf70194ea5760393851f"} Jun 02 01:23:04.460736 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:04.460697 2574 generic.go:358] "Generic (PLEG): container finished" podID="7ad1061c-6c0a-4df8-8033-d1947c7d1953" containerID="27110c779cd9ad2daadc6d26d67580e20f2b06487bbbbf70194ea5760393851f" exitCode=0 Jun 02 01:23:04.461193 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:04.460737 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" event={"ID":"7ad1061c-6c0a-4df8-8033-d1947c7d1953","Type":"ContainerDied","Data":"27110c779cd9ad2daadc6d26d67580e20f2b06487bbbbf70194ea5760393851f"} Jun 02 01:23:06.470022 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:06.469986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" event={"ID":"7ad1061c-6c0a-4df8-8033-d1947c7d1953","Type":"ContainerStarted","Data":"aa9b5c2ca5ba26852aba98a576abf6109283410641236ca2a3471acff43d9ae9"} Jun 02 01:23:06.489587 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:06.489539 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" podStartSLOduration=2.248924948 podStartE2EDuration="8.489524626s" podCreationTimestamp="2026-06-02 01:22:58 +0000 UTC" firstStartedPulling="2026-06-02 01:22:59.265800138 +0000 UTC m=+742.972766435" lastFinishedPulling="2026-06-02 01:23:05.506399816 +0000 UTC m=+749.213366113" observedRunningTime="2026-06-02 01:23:06.487575767 +0000 UTC m=+750.194542089" watchObservedRunningTime="2026-06-02 01:23:06.489524626 +0000 UTC m=+750.196490944" Jun 02 01:23:09.127039 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:09.126998 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:23:09.127502 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:09.127050 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:23:09.140693 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:09.140666 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:23:09.490833 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:09.490752 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp" Jun 02 01:23:17.494025 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.493992 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4"] Jun 02 01:23:17.520243 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.520212 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4"] Jun 02 01:23:17.520397 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.520324 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.522698 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.522679 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 01:23:17.584611 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.584756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9dh4\" (UniqueName: \"kubernetes.io/projected/66151503-f3ec-469f-a68a-fd7d63c93f65-kube-api-access-b9dh4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.584756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66151503-f3ec-469f-a68a-fd7d63c93f65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.584756 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584725 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.584880 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.584880 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.584816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686304 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686266 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66151503-f3ec-469f-a68a-fd7d63c93f65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686317 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686356 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686374 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686443 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686441 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686650 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686457 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9dh4\" (UniqueName: \"kubernetes.io/projected/66151503-f3ec-469f-a68a-fd7d63c93f65-kube-api-access-b9dh4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686837 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686837 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.686987 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.686886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.688622 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.688604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66151503-f3ec-469f-a68a-fd7d63c93f65-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.688864 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.688847 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66151503-f3ec-469f-a68a-fd7d63c93f65-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.694067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.694043 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9dh4\" (UniqueName: \"kubernetes.io/projected/66151503-f3ec-469f-a68a-fd7d63c93f65-kube-api-access-b9dh4\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4\" (UID: \"66151503-f3ec-469f-a68a-fd7d63c93f65\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.832229 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.832198 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:17.961874 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:17.961848 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4"] Jun 02 01:23:17.963643 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:23:17.963615 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66151503_f3ec_469f_a68a_fd7d63c93f65.slice/crio-cdc73639d468b588b2d79c5ce8fb2fa6d52b47e8dc72e904be87a28c4186d7d2 WatchSource:0}: Error finding container cdc73639d468b588b2d79c5ce8fb2fa6d52b47e8dc72e904be87a28c4186d7d2: Status 404 returned error can't find the container with id cdc73639d468b588b2d79c5ce8fb2fa6d52b47e8dc72e904be87a28c4186d7d2 Jun 02 01:23:18.517209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:18.517178 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" event={"ID":"66151503-f3ec-469f-a68a-fd7d63c93f65","Type":"ContainerStarted","Data":"f5dcebac5b546384c4b228ff6417f6c0d8dd6488e0aeb5f3458687092ef1eca3"} Jun 02 01:23:18.517209 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:18.517212 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" event={"ID":"66151503-f3ec-469f-a68a-fd7d63c93f65","Type":"ContainerStarted","Data":"cdc73639d468b588b2d79c5ce8fb2fa6d52b47e8dc72e904be87a28c4186d7d2"} Jun 02 01:23:19.521793 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:19.521758 2574 generic.go:358] "Generic (PLEG): container finished" podID="66151503-f3ec-469f-a68a-fd7d63c93f65" containerID="f5dcebac5b546384c4b228ff6417f6c0d8dd6488e0aeb5f3458687092ef1eca3" exitCode=0 Jun 02 01:23:19.522200 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:19.521846 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" event={"ID":"66151503-f3ec-469f-a68a-fd7d63c93f65","Type":"ContainerDied","Data":"f5dcebac5b546384c4b228ff6417f6c0d8dd6488e0aeb5f3458687092ef1eca3"} Jun 02 01:23:20.527166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:20.527136 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" event={"ID":"66151503-f3ec-469f-a68a-fd7d63c93f65","Type":"ContainerStarted","Data":"a66562d68526fd213271e437234a42392c559fd557e7b4039ec6bb8a999a704f"} Jun 02 01:23:20.546080 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:20.546032 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" podStartSLOduration=3.339038047 podStartE2EDuration="3.546015624s" podCreationTimestamp="2026-06-02 01:23:17 +0000 UTC" firstStartedPulling="2026-06-02 01:23:19.522373159 +0000 UTC m=+763.229339456" lastFinishedPulling="2026-06-02 01:23:19.729350737 +0000 UTC m=+763.436317033" observedRunningTime="2026-06-02 01:23:20.544227349 +0000 UTC m=+764.251193670" watchObservedRunningTime="2026-06-02 01:23:20.546015624 +0000 UTC m=+764.252981944" Jun 02 01:23:24.201908 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.201869 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w"] Jun 02 01:23:24.207675 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.207651 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.210792 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.210765 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 01:23:24.211912 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.211889 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w"] Jun 02 01:23:24.348992 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.348927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.349166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.349021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.349166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.349044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pps64\" (UniqueName: \"kubernetes.io/projected/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kube-api-access-pps64\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.349166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.349070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.349166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.349154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.349319 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.349192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450395 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450358 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450598 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450518 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450598 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450568 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450598 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pps64\" (UniqueName: \"kubernetes.io/projected/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kube-api-access-pps64\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450770 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450642 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450770 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450711 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450874 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450845 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.450954 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.450927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.451051 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.451025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.453084 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.453029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.453242 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.453222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.458679 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.458651 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pps64\" (UniqueName: \"kubernetes.io/projected/7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f-kube-api-access-pps64\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w\" (UID: \"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.518890 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.518867 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" Jun 02 01:23:24.650617 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:24.650588 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w"] Jun 02 01:23:24.652760 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:23:24.652728 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ccf6017_fb2b_4cf7_bf21_60cf9cec6b0f.slice/crio-63345623ba1b1b256e30cd9fb114ddb777d8fd5ed7393e998ffdbd7d9f5e94f2 WatchSource:0}: Error finding container 63345623ba1b1b256e30cd9fb114ddb777d8fd5ed7393e998ffdbd7d9f5e94f2: Status 404 returned error can't find the container with id 63345623ba1b1b256e30cd9fb114ddb777d8fd5ed7393e998ffdbd7d9f5e94f2 Jun 02 01:23:25.548088 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:25.548056 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" event={"ID":"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f","Type":"ContainerStarted","Data":"818ef22f703a5f8e37d54fc6d9959d086f94fcd65d79f2f2c8dccb5d4bde4f6a"} Jun 02 01:23:25.548487 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:25.548096 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w" event={"ID":"7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f","Type":"ContainerStarted","Data":"63345623ba1b1b256e30cd9fb114ddb777d8fd5ed7393e998ffdbd7d9f5e94f2"} Jun 02 01:23:27.832563 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:27.832530 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:27.832922 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:27.832607 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:27.845128 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:27.845108 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:23:28.577652 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:23:28.577619 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4" Jun 02 01:25:36.809532 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:25:36.809451 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:25:36.812140 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:25:36.812118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:29:11.192202 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:11.192165 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w_7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f/storage-initializer/0.log" Jun 02 01:29:16.497805 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:16.497774 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fffc7cf9-99f5j_d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61/nginx/0.log" Jun 02 01:29:16.941984 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:16.941932 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-658bb9d9dd-zpmtn_2f523549-75f2-4b96-9468-5b4b333e61eb/maas-api/0.log" Jun 02 01:29:17.057325 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:17.057290 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-769fd65d94-8lspd_3f24b764-8223-4241-b943-ddf7d37ac465/manager/0.log" Jun 02 01:29:17.513568 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:17.513542 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vc27b_a93d48db-1673-42c1-b892-a4f98971923f/copy-manifests/0.log" Jun 02 01:29:17.520631 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:17.520607 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vc27b_a93d48db-1673-42c1-b892-a4f98971923f/manager/0.log" Jun 02 01:29:17.759024 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:17.758973 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-f7ksb_f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a/postgres/0.log" Jun 02 01:29:19.084919 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:19.084887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z9tzr_92973bee-17e5-4759-934a-1769275a9929/manager/0.log" Jun 02 01:29:19.190138 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:19.190106 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kbw8b_fcfb211d-629a-4018-9869-8a3b04738b43/manager/0.log" Jun 02 01:29:19.417168 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:19.417083 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4nvmd_c5562131-4638-49a0-8260-73d7b77b8057/registry-server/0.log" Jun 02 01:29:19.538195 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:19.538163 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xn8kz_b6208203-3fc1-4c2c-8cb2-118ce45a0de4/manager/0.log" Jun 02 01:29:20.081242 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:20.081202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bzm87s_b8a22ad1-4eb4-4395-b554-14cc3f13b6b6/istio-proxy/0.log" Jun 02 01:29:20.513360 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:20.513288 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-d66mp_ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0/istio-proxy/0.log" Jun 02 01:29:20.639682 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:20.639650 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fr2ng_37633866-f188-4b96-8a0f-5a5e7b057963/payload-processing/0.log" Jun 02 01:29:20.746904 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:20.746878 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d7749b7ff-7s8wm_421b0cdb-3d99-4aa2-ac7c-2b192cf0936e/router/0.log" Jun 02 01:29:21.310366 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:21.310335 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp_7ad1061c-6c0a-4df8-8033-d1947c7d1953/main/0.log" Jun 02 01:29:21.316699 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:21.316679 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-pcgvp_7ad1061c-6c0a-4df8-8033-d1947c7d1953/storage-initializer/0.log" Jun 02 01:29:21.542416 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:21.542380 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4_66151503-f3ec-469f-a68a-fd7d63c93f65/storage-initializer/0.log" Jun 02 01:29:21.550075 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:21.550047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-rxvb4_66151503-f3ec-469f-a68a-fd7d63c93f65/main/0.log" Jun 02 01:29:21.659224 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:21.659157 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-7fb2w_7ccf6017-fb2b-4cf7-bf21-60cf9cec6b0f/storage-initializer/0.log" Jun 02 01:29:28.237028 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:28.237000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-np4n4_23898999-3e85-4d71-b2b3-2497238e9dcb/global-pull-secret-syncer/0.log" Jun 02 01:29:28.326271 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:28.326234 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8fttr_abca0dbc-7c0a-4399-a9a5-ffa0def41541/konnectivity-agent/0.log" Jun 02 01:29:28.514784 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:28.514692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-243.ec2.internal_b2adab5e9a55efbec8341207fb2d61ea/haproxy/0.log" Jun 02 01:29:32.569731 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:32.569701 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-z9tzr_92973bee-17e5-4759-934a-1769275a9929/manager/0.log" Jun 02 01:29:32.595821 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:32.595793 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kbw8b_fcfb211d-629a-4018-9869-8a3b04738b43/manager/0.log" Jun 02 01:29:32.662043 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:32.662013 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4nvmd_c5562131-4638-49a0-8260-73d7b77b8057/registry-server/0.log" Jun 02 01:29:32.713633 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:32.713605 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xn8kz_b6208203-3fc1-4c2c-8cb2-118ce45a0de4/manager/0.log" Jun 02 01:29:34.288127 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.288041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-xk5qj_d57fb365-0ee9-427f-986b-75c25cdeb227/kube-state-metrics/0.log" Jun 02 01:29:34.321018 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.320990 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-xk5qj_d57fb365-0ee9-427f-986b-75c25cdeb227/kube-rbac-proxy-main/0.log" Jun 02 01:29:34.350157 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.350130 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-xk5qj_d57fb365-0ee9-427f-986b-75c25cdeb227/kube-rbac-proxy-self/0.log" Jun 02 01:29:34.449464 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.449427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjcq_4248a1e7-9d7b-4b79-a868-fb9c24388fc1/node-exporter/0.log" Jun 02 01:29:34.476034 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.476012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjcq_4248a1e7-9d7b-4b79-a868-fb9c24388fc1/kube-rbac-proxy/0.log" Jun 02 01:29:34.497697 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.497674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6zjcq_4248a1e7-9d7b-4b79-a868-fb9c24388fc1/init-textfile/0.log" Jun 02 01:29:34.795496 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.795451 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/prometheus/0.log" Jun 02 01:29:34.815305 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.815274 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/config-reloader/0.log" Jun 02 01:29:34.837141 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.837076 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/thanos-sidecar/0.log" Jun 02 01:29:34.857483 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.857465 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/kube-rbac-proxy-web/0.log" Jun 02 01:29:34.885617 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.885595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/kube-rbac-proxy/0.log" Jun 02 01:29:34.906322 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.906296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/kube-rbac-proxy-thanos/0.log" Jun 02 01:29:34.927895 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.927879 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_168a02b3-9ad9-4d1e-80ed-994b6d3dc97e/init-config-reloader/0.log" Jun 02 01:29:34.956484 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.956459 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hslcs_068e3390-2fb0-4321-ac49-ecbe20948a39/prometheus-operator/0.log" Jun 02 01:29:34.974166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:34.974145 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-hslcs_068e3390-2fb0-4321-ac49-ecbe20948a39/kube-rbac-proxy/0.log" Jun 02 01:29:36.254363 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:36.254310 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-nwhlb_3cf2ffb3-f0f0-4805-9c8c-cf6d9ec507af/networking-console-plugin/0.log" Jun 02 01:29:37.334997 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.334947 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-bbcj5_3a68fc1c-dd93-48e8-9793-46d994db41c6/download-server/0.log" Jun 02 01:29:37.854381 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.854338 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw"] Jun 02 01:29:37.858145 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.858123 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:37.860502 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.860476 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2tbbt\"/\"default-dockercfg-w25v7\"" Jun 02 01:29:37.860787 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.860767 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"openshift-service-ca.crt\"" Jun 02 01:29:37.861644 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.861629 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2tbbt\"/\"kube-root-ca.crt\"" Jun 02 01:29:37.866583 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.866562 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw"] Jun 02 01:29:37.878958 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.878938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-7vjb7_c286172a-f562-41d9-9445-3bfebcb9e54e/volume-data-source-validator/0.log" Jun 02 01:29:37.980780 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.980753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8wxd\" (UniqueName: \"kubernetes.io/projected/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-kube-api-access-n8wxd\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:37.980893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.980812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-lib-modules\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:37.980893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.980861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-sys\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:37.980893 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.980885 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-podres\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:37.981064 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:37.980928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-proc\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.081845 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.081822 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-lib-modules\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.081992 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.081868 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-sys\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.081992 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.081917 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-podres\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.081992 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.081932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-sys\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.082107 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.081995 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-proc\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.082107 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.082028 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8wxd\" (UniqueName: \"kubernetes.io/projected/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-kube-api-access-n8wxd\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.082107 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.082054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-lib-modules\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.082107 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.082054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-podres\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.082229 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.082109 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-proc\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.090024 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.089999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8wxd\" (UniqueName: \"kubernetes.io/projected/27f2cd1e-06dd-41b0-9df0-811fa0f68e7d-kube-api-access-n8wxd\") pod \"perf-node-gather-daemonset-2j8mw\" (UID: \"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d\") " pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.168904 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.168839 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.297867 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.297844 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw"] Jun 02 01:29:38.299917 ip-10-0-139-243 kubenswrapper[2574]: W0602 01:29:38.299886 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod27f2cd1e_06dd_41b0_9df0_811fa0f68e7d.slice/crio-a1b75ec92094c6cceb59673cfa7d586d0d7c6412480b25b2b602861d797d22ef WatchSource:0}: Error finding container a1b75ec92094c6cceb59673cfa7d586d0d7c6412480b25b2b602861d797d22ef: Status 404 returned error can't find the container with id a1b75ec92094c6cceb59673cfa7d586d0d7c6412480b25b2b602861d797d22ef Jun 02 01:29:38.301509 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.301494 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:29:38.749166 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.749070 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6qf_990d3632-d0a1-43f5-8d8c-d0149df6d297/dns/0.log" Jun 02 01:29:38.768828 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.768796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8q6qf_990d3632-d0a1-43f5-8d8c-d0149df6d297/kube-rbac-proxy/0.log" Jun 02 01:29:38.887003 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.886951 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h987k_89f2be46-581c-4926-8631-dbff6e479f27/dns-node-resolver/0.log" Jun 02 01:29:38.894422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.894391 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" event={"ID":"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d","Type":"ContainerStarted","Data":"66feddcc39b9aac2f567623be723d1c4bb19fc5b3b1cf5568359bdb98d40679e"} Jun 02 01:29:38.894422 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.894422 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" event={"ID":"27f2cd1e-06dd-41b0-9df0-811fa0f68e7d","Type":"ContainerStarted","Data":"a1b75ec92094c6cceb59673cfa7d586d0d7c6412480b25b2b602861d797d22ef"} Jun 02 01:29:38.894629 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.894497 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:38.911368 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:38.911323 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" podStartSLOduration=1.911311371 podStartE2EDuration="1.911311371s" podCreationTimestamp="2026-06-02 01:29:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:29:38.908741741 +0000 UTC m=+1142.615708059" watchObservedRunningTime="2026-06-02 01:29:38.911311371 +0000 UTC m=+1142.618277691" Jun 02 01:29:39.454989 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:39.452843 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2wmnp_8e4b6097-6a91-4ca2-8eac-ecaa40ef91ce/node-ca/0.log" Jun 02 01:29:40.340145 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:40.340114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bzm87s_b8a22ad1-4eb4-4395-b554-14cc3f13b6b6/istio-proxy/0.log" Jun 02 01:29:40.465537 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:40.465505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-d66mp_ad3d39a0-0ecd-4012-9b2c-13dc2a7cc6b0/istio-proxy/0.log" Jun 02 01:29:40.488529 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:40.488503 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-fr2ng_37633866-f188-4b96-8a0f-5a5e7b057963/payload-processing/0.log" Jun 02 01:29:40.511540 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:40.511516 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d7749b7ff-7s8wm_421b0cdb-3d99-4aa2-ac7c-2b192cf0936e/router/0.log" Jun 02 01:29:41.072170 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.072143 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-98ph6_68b1b821-9cfd-44c0-82d7-71129551079f/serve-healthcheck-canary/0.log" Jun 02 01:29:41.545460 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.545426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-tl6jd_d1a16c67-2f9d-4f2d-82cd-44ce034776b0/insights-operator/0.log" Jun 02 01:29:41.546068 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.546043 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-tl6jd_d1a16c67-2f9d-4f2d-82cd-44ce034776b0/insights-operator/1.log" Jun 02 01:29:41.566341 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.566316 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x5mq_93554440-39c5-4cc1-a592-342d3e0298ec/kube-rbac-proxy/0.log" Jun 02 01:29:41.585468 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.585446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x5mq_93554440-39c5-4cc1-a592-342d3e0298ec/exporter/0.log" Jun 02 01:29:41.606332 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:41.606314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7x5mq_93554440-39c5-4cc1-a592-342d3e0298ec/extractor/0.log" Jun 02 01:29:43.642321 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:43.642293 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78fffc7cf9-99f5j_d5c66e9d-8cbd-4d6e-86df-13fd27a0dd61/nginx/0.log" Jun 02 01:29:43.744054 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:43.744012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-658bb9d9dd-zpmtn_2f523549-75f2-4b96-9468-5b4b333e61eb/maas-api/0.log" Jun 02 01:29:43.771330 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:43.771305 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-769fd65d94-8lspd_3f24b764-8223-4241-b943-ddf7d37ac465/manager/0.log" Jun 02 01:29:43.922244 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:43.922162 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vc27b_a93d48db-1673-42c1-b892-a4f98971923f/manager/0.log" Jun 02 01:29:43.941101 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:43.941078 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8cb464b-vc27b_a93d48db-1673-42c1-b892-a4f98971923f/copy-manifests/0.log" Jun 02 01:29:44.098298 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:44.098270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-f7ksb_f622a31a-ed04-4da5-abbd-d2ce9a8d9f3a/postgres/0.log" Jun 02 01:29:44.907824 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:44.907801 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2tbbt/perf-node-gather-daemonset-2j8mw" Jun 02 01:29:45.411082 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:45.411024 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c7648845d-fk47f_52d81578-788f-4517-9785-a9da6060f09d/manager/0.log" Jun 02 01:29:50.181873 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:50.181840 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-t8brt_f28c6a75-7eda-4ec3-89db-28d488ee9641/migrator/0.log" Jun 02 01:29:50.200234 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:50.200206 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-t8brt_f28c6a75-7eda-4ec3-89db-28d488ee9641/graceful-termination/0.log" Jun 02 01:29:50.587428 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:50.587389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-qfv92_5dd867a7-f801-421e-a366-dd3daf7e7402/kube-storage-version-migrator-operator/1.log" Jun 02 01:29:50.589236 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:50.589215 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-qfv92_5dd867a7-f801-421e-a366-dd3daf7e7402/kube-storage-version-migrator-operator/0.log" Jun 02 01:29:51.682724 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.682691 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/kube-multus-additional-cni-plugins/0.log" Jun 02 01:29:51.703196 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.703175 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/egress-router-binary-copy/0.log" Jun 02 01:29:51.720808 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.720786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/cni-plugins/0.log" Jun 02 01:29:51.742537 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.742512 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/bond-cni-plugin/0.log" Jun 02 01:29:51.768289 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.768270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/routeoverride-cni/0.log" Jun 02 01:29:51.788337 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.788318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/whereabouts-cni-bincopy/0.log" Jun 02 01:29:51.807136 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:51.807118 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mfc97_8b01b22e-855d-46c1-bb85-4c3e7e93ac00/whereabouts-cni/0.log" Jun 02 01:29:52.032380 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:52.032354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xl7d9_e183d1bb-1ca8-4af4-874c-2460440d1f96/kube-multus/0.log" Jun 02 01:29:52.077705 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:52.077682 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cns8m_d6b04cb3-93e1-4110-a31b-88b4fd21a5b3/network-metrics-daemon/0.log" Jun 02 01:29:52.095341 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:52.095316 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cns8m_d6b04cb3-93e1-4110-a31b-88b4fd21a5b3/kube-rbac-proxy/0.log" Jun 02 01:29:53.611348 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.611307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-controller/0.log" Jun 02 01:29:53.626950 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.626911 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/0.log" Jun 02 01:29:53.637529 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.637500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovn-acl-logging/1.log" Jun 02 01:29:53.659631 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.659599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/kube-rbac-proxy-node/0.log" Jun 02 01:29:53.679055 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.678992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 01:29:53.696411 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.696390 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/northd/0.log" Jun 02 01:29:53.715688 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.715663 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/nbdb/0.log" Jun 02 01:29:53.737067 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.737039 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/sbdb/0.log" Jun 02 01:29:53.903589 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:53.903513 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-p7rbj_7876d5a4-0515-40ed-ba3b-39b44df08775/ovnkube-controller/0.log" Jun 02 01:29:55.058646 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:55.058613 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-7gkt9_aa2cea85-4394-4d37-a875-97b5471d384f/check-endpoints/0.log" Jun 02 01:29:55.103264 ip-10-0-139-243 kubenswrapper[2574]: I0602 01:29:55.103238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9glg4_8daa06c1-9a4c-4575-8115-f836c5bfa8ac/network-check-target-container/0.log"