May 26 10:07:24.286249 ip-10-0-140-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 26 10:07:24.286262 ip-10-0-140-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 26 10:07:24.286269 ip-10-0-140-253 systemd[1]: kubelet.service: Failed with result 'resources'. May 26 10:07:24.286503 ip-10-0-140-253 systemd[1]: Failed to start Kubernetes Kubelet. May 26 10:07:35.482540 ip-10-0-140-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 26 10:07:35.482562 ip-10-0-140-253 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fdf1796e336a4e358851e494b3162b37 -- May 26 10:10:04.484928 ip-10-0-140-253 systemd[1]: Starting Kubernetes Kubelet... May 26 10:10:04.927797 ip-10-0-140-253 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:04.927797 ip-10-0-140-253 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 26 10:10:04.927797 ip-10-0-140-253 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:04.927797 ip-10-0-140-253 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 26 10:10:04.927797 ip-10-0-140-253 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 26 10:10:04.928723 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.928566 2559 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 26 10:10:04.932381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932365 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:04.932381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932381 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932385 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932389 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932392 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932395 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932397 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932400 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932403 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932406 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932408 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932412 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932414 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932417 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932422 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932426 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932429 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932432 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932442 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932445 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932447 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:04.932455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932451 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932455 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932459 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932462 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932465 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932468 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932471 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932473 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932476 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932479 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932481 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932484 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932486 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932490 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932493 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932495 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932498 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932500 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932503 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:04.932967 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932506 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932509 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932511 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932514 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932516 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932519 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932527 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932529 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932532 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932535 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932539 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932542 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932544 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932547 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932551 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932555 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932558 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932561 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932563 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:04.933442 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932566 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932568 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932571 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932573 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932576 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932579 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932581 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932584 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932587 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932590 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932592 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932595 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932597 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932600 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932602 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932605 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932608 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932611 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932614 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932617 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:04.933907 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932619 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932622 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932624 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932627 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932644 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932649 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.932653 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933057 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933062 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933065 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933067 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933070 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933073 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933075 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933078 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933081 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933084 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933086 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933089 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933092 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:04.934378 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933095 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933097 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933100 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933102 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933105 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933107 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933110 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933112 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933115 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933118 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933120 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933123 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933125 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933128 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933131 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933133 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933136 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933138 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933141 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:04.934908 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933144 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933146 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933149 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933152 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933155 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933157 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933160 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933162 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933166 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933168 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933171 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933173 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933176 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933178 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933181 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933183 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933186 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933188 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933190 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933195 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:04.935381 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933198 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933202 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933205 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933208 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933211 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933213 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933216 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933219 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933221 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933224 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933227 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933229 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933232 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933235 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933237 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933240 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933242 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933246 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933248 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933250 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:04.935996 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933253 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933255 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933258 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933260 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933262 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933265 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933267 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933270 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933273 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933275 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933278 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933281 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933283 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.933287 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934495 2559 flags.go:64] FLAG: --address="0.0.0.0" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934505 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934512 2559 flags.go:64] FLAG: --anonymous-auth="true" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934521 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934525 2559 flags.go:64] FLAG: --authentication-token-webhook="false" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934528 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 26 10:10:04.936523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934533 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934538 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934541 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934544 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934547 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934551 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934555 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934558 2559 flags.go:64] FLAG: --cgroup-root="" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934561 2559 flags.go:64] FLAG: --cgroups-per-qos="true" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934564 2559 flags.go:64] FLAG: --client-ca-file="" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934567 2559 flags.go:64] FLAG: --cloud-config="" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934570 2559 flags.go:64] FLAG: --cloud-provider="external" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934573 2559 flags.go:64] FLAG: --cluster-dns="[]" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934578 2559 flags.go:64] FLAG: --cluster-domain="" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934581 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934584 2559 flags.go:64] FLAG: --config-dir="" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934587 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934591 2559 flags.go:64] FLAG: --container-log-max-files="5" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934595 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934598 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934601 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934605 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934608 2559 flags.go:64] FLAG: --contention-profiling="false" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934611 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" May 26 10:10:04.937030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934614 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934617 2559 flags.go:64] FLAG: --cpu-manager-policy="none" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934620 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934624 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934627 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934643 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934646 2559 flags.go:64] FLAG: --enable-load-reader="false" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934649 2559 flags.go:64] FLAG: --enable-server="true" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934652 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934657 2559 flags.go:64] FLAG: --event-burst="100" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934660 2559 flags.go:64] FLAG: --event-qps="50" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934663 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934666 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934669 2559 flags.go:64] FLAG: --eviction-hard="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934673 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934676 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934679 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934682 2559 flags.go:64] FLAG: --eviction-soft="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934685 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934688 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934691 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934693 2559 flags.go:64] FLAG: --experimental-mounter-path="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934696 2559 flags.go:64] FLAG: --fail-cgroupv1="false" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934699 2559 flags.go:64] FLAG: --fail-swap-on="true" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934703 2559 flags.go:64] FLAG: --feature-gates="" May 26 10:10:04.937620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934706 2559 flags.go:64] FLAG: --file-check-frequency="20s" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934709 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934712 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934715 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934719 2559 flags.go:64] FLAG: --healthz-port="10248" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934722 2559 flags.go:64] FLAG: --help="false" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934725 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-140-253.ec2.internal" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934728 2559 flags.go:64] FLAG: --housekeeping-interval="10s" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934731 2559 flags.go:64] FLAG: --http-check-frequency="20s" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934734 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934737 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934741 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934743 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934746 2559 flags.go:64] FLAG: --image-service-endpoint="" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934749 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934752 2559 flags.go:64] FLAG: --kube-api-burst="100" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934754 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934757 2559 flags.go:64] FLAG: --kube-api-qps="50" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934760 2559 flags.go:64] FLAG: --kube-reserved="" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934763 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934767 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934770 2559 flags.go:64] FLAG: --kubelet-cgroups="" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934772 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934775 2559 flags.go:64] FLAG: --lock-file="" May 26 10:10:04.938246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934778 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934781 2559 flags.go:64] FLAG: --log-flush-frequency="5s" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934784 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934789 2559 flags.go:64] FLAG: --log-json-split-stream="false" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934792 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934795 2559 flags.go:64] FLAG: --log-text-split-stream="false" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934797 2559 flags.go:64] FLAG: --logging-format="text" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934800 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934804 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934807 2559 flags.go:64] FLAG: --manifest-url="" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934810 2559 flags.go:64] FLAG: --manifest-url-header="" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934815 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934818 2559 flags.go:64] FLAG: --max-open-files="1000000" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934822 2559 flags.go:64] FLAG: --max-pods="110" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934825 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934828 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934832 2559 flags.go:64] FLAG: --memory-manager-policy="None" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934834 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934837 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934840 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934843 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934850 2559 flags.go:64] FLAG: --node-status-max-images="50" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934854 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934857 2559 flags.go:64] FLAG: --oom-score-adj="-999" May 26 10:10:04.938843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934860 2559 flags.go:64] FLAG: --pod-cidr="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934863 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934872 2559 flags.go:64] FLAG: --pod-manifest-path="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934876 2559 flags.go:64] FLAG: --pod-max-pids="-1" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934879 2559 flags.go:64] FLAG: --pods-per-core="0" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934882 2559 flags.go:64] FLAG: --port="10250" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934885 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934887 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0179018b8facd238f" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934890 2559 flags.go:64] FLAG: --qos-reserved="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934893 2559 flags.go:64] FLAG: --read-only-port="10255" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934896 2559 flags.go:64] FLAG: --register-node="true" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934899 2559 flags.go:64] FLAG: --register-schedulable="true" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934901 2559 flags.go:64] FLAG: --register-with-taints="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934905 2559 flags.go:64] FLAG: --registry-burst="10" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934908 2559 flags.go:64] FLAG: --registry-qps="5" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934911 2559 flags.go:64] FLAG: --reserved-cpus="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934914 2559 flags.go:64] FLAG: --reserved-memory="" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934918 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934921 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934924 2559 flags.go:64] FLAG: --rotate-certificates="false" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934927 2559 flags.go:64] FLAG: --rotate-server-certificates="false" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934930 2559 flags.go:64] FLAG: --runonce="false" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934933 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934936 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934939 2559 flags.go:64] FLAG: --seccomp-default="false" May 26 10:10:04.939422 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934942 2559 flags.go:64] FLAG: --serialize-image-pulls="true" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934945 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934947 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934951 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934954 2559 flags.go:64] FLAG: --storage-driver-password="root" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934956 2559 flags.go:64] FLAG: --storage-driver-secure="false" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934959 2559 flags.go:64] FLAG: --storage-driver-table="stats" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934962 2559 flags.go:64] FLAG: --storage-driver-user="root" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934965 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934968 2559 flags.go:64] FLAG: --sync-frequency="1m0s" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934973 2559 flags.go:64] FLAG: --system-cgroups="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934976 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934981 2559 flags.go:64] FLAG: --system-reserved-cgroup="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934984 2559 flags.go:64] FLAG: --tls-cert-file="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934987 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934991 2559 flags.go:64] FLAG: --tls-min-version="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934994 2559 flags.go:64] FLAG: --tls-private-key-file="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934997 2559 flags.go:64] FLAG: --topology-manager-policy="none" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.934999 2559 flags.go:64] FLAG: --topology-manager-policy-options="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935002 2559 flags.go:64] FLAG: --topology-manager-scope="container" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935006 2559 flags.go:64] FLAG: --v="2" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935010 2559 flags.go:64] FLAG: --version="false" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935014 2559 flags.go:64] FLAG: --vmodule="" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935018 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935021 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 26 10:10:04.940030 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935113 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935116 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935119 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935122 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935125 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935128 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935131 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935134 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935137 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935139 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935142 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935144 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935147 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935149 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935151 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935154 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935156 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935160 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935163 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935166 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:04.940697 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935168 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935171 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935173 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935176 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935178 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935181 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935183 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935186 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935188 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935191 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935193 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935196 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935198 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935201 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935203 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935206 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935208 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935211 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935213 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935216 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:04.941207 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935218 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935221 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935224 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935226 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935229 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935231 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935234 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935236 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935239 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935242 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935245 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935247 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935250 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935252 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935254 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935257 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935260 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935264 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935266 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:04.941921 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935269 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935273 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935277 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935280 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935283 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935286 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935289 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935291 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935294 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935297 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935299 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935302 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935304 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935307 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935309 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935312 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935314 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935317 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935319 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:04.942456 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935322 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935324 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935327 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935330 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935333 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935335 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935338 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.935340 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:04.942956 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.935345 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.943082 2559 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.943098 2559 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943147 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943152 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943155 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943158 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943161 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943164 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943167 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943170 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943172 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943175 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943178 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943180 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943182 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943185 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943187 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943190 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:04.943192 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943193 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943196 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943198 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943201 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943204 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943207 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943211 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943214 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943216 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943219 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943222 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943224 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943227 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943230 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943232 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943235 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943237 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943239 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943242 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:04.943679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943244 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943247 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943249 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943252 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943254 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943257 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943260 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943262 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943265 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943267 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943269 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943274 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943276 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943279 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943282 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943285 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943287 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943290 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943293 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:04.944156 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943295 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943298 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943301 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943303 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943306 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943308 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943311 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943313 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943315 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943318 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943320 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943323 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943325 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943328 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943330 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943332 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943335 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943339 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943343 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943346 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:04.944688 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943349 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943352 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943355 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943357 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943360 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943362 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943364 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943368 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943370 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943373 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943376 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.943380 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943475 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943481 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943484 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943486 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 26 10:10:04.945182 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943489 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943492 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943494 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943497 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943501 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943505 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943507 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943511 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943513 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943516 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943518 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943521 2559 feature_gate.go:328] unrecognized feature gate: Example2 May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943523 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943526 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943528 2559 feature_gate.go:328] unrecognized feature gate: DualReplica May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943531 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943533 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943536 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943539 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943542 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 26 10:10:04.945586 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943545 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943547 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943550 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943553 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943557 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943559 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943562 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943564 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943567 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943569 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943572 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943574 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943576 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943579 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943581 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943584 2559 feature_gate.go:328] unrecognized feature gate: Example May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943586 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943589 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943591 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943594 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 26 10:10:04.946124 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943596 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943599 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943601 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943603 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943606 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943608 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943611 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943613 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943616 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943618 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943621 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943624 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943627 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943646 2559 feature_gate.go:328] unrecognized feature gate: NewOLM May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943653 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943658 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943661 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943663 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943666 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943668 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 26 10:10:04.946621 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943671 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943673 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943676 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943678 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943681 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943684 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943686 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943689 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943692 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943695 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943697 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943700 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943702 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943704 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943707 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943709 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943711 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943714 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943716 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 26 10:10:04.947135 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943719 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 26 10:10:04.947611 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943721 2559 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 26 10:10:04.947611 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:04.943724 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 26 10:10:04.947611 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.943729 2559 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 26 10:10:04.947611 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.944559 2559 server.go:962] "Client rotation is on, will bootstrap in background" May 26 10:10:04.948480 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.948466 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 26 10:10:04.949397 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.949384 2559 server.go:1019] "Starting client certificate rotation" May 26 10:10:04.949493 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.949478 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 10:10:04.949533 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.949518 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 26 10:10:04.973547 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.973528 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 10:10:04.975383 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.975363 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 26 10:10:04.997354 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:04.997331 2559 log.go:25] "Validated CRI v1 runtime API" May 26 10:10:05.004800 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.004784 2559 log.go:25] "Validated CRI v1 image API" May 26 10:10:05.006169 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.006152 2559 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 26 10:10:05.007624 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.007609 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 10:10:05.010222 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.010204 2559 fs.go:135] Filesystem UUIDs: map[153cbfcc-885e-4ed0-a1ce-ff673fea1714:/dev/nvme0n1p4 653ae2c7-e8e3-4fe4-b7be-116ae81b1a98:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] May 26 10:10:05.010271 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.010223 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 26 10:10:05.014455 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.014345 2559 manager.go:217] Machine: {Timestamp:2026-05-26 10:10:05.013861758 +0000 UTC m=+0.409970885 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140955 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a32b3aeeee1a27f4e1ca68d431cc9 SystemUUID:ec2a32b3-aeee-e1a2-7f4e-1ca68d431cc9 BootID:fdf1796e-336a-4e35-8851-e494b3162b37 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:aa:08:17:96:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:aa:08:17:96:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:21:53:a9:1e:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 26 10:10:05.015960 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.015949 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 26 10:10:05.016053 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.016036 2559 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 26 10:10:05.018963 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.018939 2559 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 26 10:10:05.019107 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.018966 2559 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 26 10:10:05.019153 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.019116 2559 topology_manager.go:138] "Creating topology manager with none policy" May 26 10:10:05.019153 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.019125 2559 container_manager_linux.go:306] "Creating device plugin manager" May 26 10:10:05.019153 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.019132 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 10:10:05.020088 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.020077 2559 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 26 10:10:05.021830 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.021820 2559 state_mem.go:36] "Initialized new in-memory state store" May 26 10:10:05.021944 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.021936 2559 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 26 10:10:05.025090 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.025079 2559 kubelet.go:491] "Attempting to sync node with API server" May 26 10:10:05.025130 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.025098 2559 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 26 10:10:05.025130 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.025110 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 26 10:10:05.025130 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.025120 2559 kubelet.go:397] "Adding apiserver pod source" May 26 10:10:05.025130 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.025128 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 26 10:10:05.026560 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.026546 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 10:10:05.026606 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.026572 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 26 10:10:05.031232 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.031212 2559 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 26 10:10:05.033611 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.033597 2559 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 26 10:10:05.034546 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034533 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034551 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034556 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034562 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034570 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034575 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034581 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034586 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034592 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 26 10:10:05.034607 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034599 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 26 10:10:05.034855 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.034613 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 26 10:10:05.035075 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.035067 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 26 10:10:05.035968 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.035958 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 26 10:10:05.036005 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.035970 2559 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 26 10:10:05.039171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.039156 2559 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 26 10:10:05.039259 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.039192 2559 server.go:1295] "Started kubelet" May 26 10:10:05.039310 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.039262 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 26 10:10:05.039523 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.039449 2559 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 26 10:10:05.039594 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.039582 2559 server_v1.go:47] "podresources" method="list" useActivePods=true May 26 10:10:05.040164 ip-10-0-140-253 systemd[1]: Started Kubernetes Kubelet. May 26 10:10:05.040408 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.040394 2559 server.go:317] "Adding debug handlers to kubelet server" May 26 10:10:05.041210 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.041167 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 26 10:10:05.041299 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.041247 2559 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 26 10:10:05.041355 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.041319 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 26 10:10:05.042814 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.042788 2559 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 26 10:10:05.048127 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.046776 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-253.ec2.internal.18b315c302144fde default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-253.ec2.internal,UID:ip-10-0-140-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-253.ec2.internal,},FirstTimestamp:2026-05-26 10:10:05.039169502 +0000 UTC m=+0.435278631,LastTimestamp:2026-05-26 10:10:05.039169502 +0000 UTC m=+0.435278631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-253.ec2.internal,}" May 26 10:10:05.052643 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.052609 2559 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 26 10:10:05.054351 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054339 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 26 10:10:05.054417 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054353 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 26 10:10:05.054701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054679 2559 volume_manager.go:295] "The desired_state_of_world populator starts" May 26 10:10:05.054701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054702 2559 volume_manager.go:297] "Starting Kubelet Volume Manager" May 26 10:10:05.054863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054845 2559 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 26 10:10:05.054950 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054937 2559 reconstruct.go:97] "Volume reconstruction finished" May 26 10:10:05.055004 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.054954 2559 reconciler.go:26] "Reconciler: start to sync state" May 26 10:10:05.055072 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055052 2559 factory.go:55] Registering systemd factory May 26 10:10:05.055072 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055075 2559 factory.go:223] Registration of the systemd container factory successfully May 26 10:10:05.055323 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.055300 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.055575 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055553 2559 factory.go:153] Registering CRI-O factory May 26 10:10:05.055692 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055583 2559 factory.go:223] Registration of the crio container factory successfully May 26 10:10:05.055692 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055661 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 26 10:10:05.055692 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055683 2559 factory.go:103] Registering Raw factory May 26 10:10:05.055839 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.055760 2559 manager.go:1196] Started watching for new ooms in manager May 26 10:10:05.056312 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.056298 2559 manager.go:319] Starting recovery of all containers May 26 10:10:05.061391 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.061327 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q4zvt" May 26 10:10:05.067654 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.067620 2559 manager.go:324] Recovery completed May 26 10:10:05.068066 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.068025 2559 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 26 10:10:05.068122 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.068032 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 26 10:10:05.069568 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.069552 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q4zvt" May 26 10:10:05.071928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.071918 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.074061 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074044 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.074143 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074074 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.074143 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074083 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.074608 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074593 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" May 26 10:10:05.074608 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074606 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 26 10:10:05.074721 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.074621 2559 state_mem.go:36] "Initialized new in-memory state store" May 26 10:10:05.078097 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.078083 2559 policy_none.go:49] "None policy: Start" May 26 10:10:05.078150 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.078100 2559 memory_manager.go:186] "Starting memorymanager" policy="None" May 26 10:10:05.078150 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.078110 2559 state_mem.go:35] "Initializing new in-memory state store" May 26 10:10:05.119218 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119201 2559 manager.go:341] "Starting Device Plugin manager" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.119234 2559 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119243 2559 server.go:85] "Starting device plugin registration server" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119520 2559 eviction_manager.go:189] "Eviction manager: starting control loop" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119531 2559 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119620 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119713 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.119724 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.120163 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 26 10:10:05.142883 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.120193 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.197376 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.197299 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 26 10:10:05.198578 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.198559 2559 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 26 10:10:05.198648 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.198599 2559 status_manager.go:230] "Starting to sync pod status with apiserver" May 26 10:10:05.198648 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.198624 2559 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 26 10:10:05.198763 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.198653 2559 kubelet.go:2451] "Starting kubelet main sync loop" May 26 10:10:05.198827 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.198768 2559 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 26 10:10:05.202055 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.202033 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:05.219912 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.219884 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.220804 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.220789 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.220912 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.220824 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.220912 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.220841 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.220912 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.220878 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-253.ec2.internal" May 26 10:10:05.233450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.233422 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-253.ec2.internal" May 26 10:10:05.233450 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.233446 2559 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-253.ec2.internal\": node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.275568 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.275539 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.298901 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.298872 2559 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal"] May 26 10:10:05.298987 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.298960 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.299880 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.299865 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.299937 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.299896 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.299937 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.299908 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.301231 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301218 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.301428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301396 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.301480 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301429 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.301933 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301917 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.301992 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301946 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.301992 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.301959 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.302295 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.302277 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.302379 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.302305 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.302379 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.302314 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.303047 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.303027 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:05.303117 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.303058 2559 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 26 10:10:05.303669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.303655 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientMemory" May 26 10:10:05.303736 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.303678 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasNoDiskPressure" May 26 10:10:05.303736 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.303691 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeHasSufficientPID" May 26 10:10:05.326411 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.326385 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-253.ec2.internal\" not found" node="ip-10-0-140-253.ec2.internal" May 26 10:10:05.330885 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.330865 2559 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-253.ec2.internal\" not found" node="ip-10-0-140-253.ec2.internal" May 26 10:10:05.375675 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.375625 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.457001 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.456908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.457001 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.456948 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.457001 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.456973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4f0c297da793ecb55c38231a69a5ccb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"c4f0c297da793ecb55c38231a69a5ccb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:05.476157 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.476112 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.557696 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557655 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.557809 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557718 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.557809 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557745 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.557809 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557791 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4f0c297da793ecb55c38231a69a5ccb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"c4f0c297da793ecb55c38231a69a5ccb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:05.557925 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557832 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c4f0c297da793ecb55c38231a69a5ccb-config\") pod \"kube-apiserver-proxy-ip-10-0-140-253.ec2.internal\" (UID: \"c4f0c297da793ecb55c38231a69a5ccb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:05.557925 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.557853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a2fabbcd11a4c7d6877e6fc4f887e26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal\" (UID: \"9a2fabbcd11a4c7d6877e6fc4f887e26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.576751 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.576727 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.628945 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.628913 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:05.633785 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.633765 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:05.677651 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.677609 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.778227 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.778171 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.878734 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.878696 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:05.948850 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.948811 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 26 10:10:05.949623 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:05.948970 2559 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 26 10:10:05.979550 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:05.979390 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:06.054557 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.054461 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 26 10:10:06.062356 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.062334 2559 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 26 10:10:06.065431 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.065415 2559 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:06.071969 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.071939 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 10:05:05 +0000 UTC" deadline="2027-11-05 07:02:04.265365196 +0000 UTC" May 26 10:10:06.071969 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.071969 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12668h51m58.193399024s" May 26 10:10:06.080080 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:06.080056 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:06.148428 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:06.148365 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2fabbcd11a4c7d6877e6fc4f887e26.slice/crio-b32b4be1d8f447e6419135d44708a74c575e766834032985fc3ebc6ed3dbd2b8 WatchSource:0}: Error finding container b32b4be1d8f447e6419135d44708a74c575e766834032985fc3ebc6ed3dbd2b8: Status 404 returned error can't find the container with id b32b4be1d8f447e6419135d44708a74c575e766834032985fc3ebc6ed3dbd2b8 May 26 10:10:06.148667 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:06.148618 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f0c297da793ecb55c38231a69a5ccb.slice/crio-101f196276c7bce1790cc75559c7cf5b6bec0ad7e666eff13e505d8a6991fd4e WatchSource:0}: Error finding container 101f196276c7bce1790cc75559c7cf5b6bec0ad7e666eff13e505d8a6991fd4e: Status 404 returned error can't find the container with id 101f196276c7bce1790cc75559c7cf5b6bec0ad7e666eff13e505d8a6991fd4e May 26 10:10:06.152924 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.152908 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:10:06.164601 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.164579 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjjlb" May 26 10:10:06.176043 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.176026 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjjlb" May 26 10:10:06.180904 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:06.180887 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:06.201980 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.201928 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"9a2fabbcd11a4c7d6877e6fc4f887e26","Type":"ContainerStarted","Data":"b32b4be1d8f447e6419135d44708a74c575e766834032985fc3ebc6ed3dbd2b8"} May 26 10:10:06.202884 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.202853 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" event={"ID":"c4f0c297da793ecb55c38231a69a5ccb","Type":"ContainerStarted","Data":"101f196276c7bce1790cc75559c7cf5b6bec0ad7e666eff13e505d8a6991fd4e"} May 26 10:10:06.281351 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:06.281321 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:06.293493 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.293467 2559 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:06.381527 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:06.381443 2559 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-253.ec2.internal\" not found" May 26 10:10:06.381682 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.381651 2559 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:06.455492 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.455459 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" May 26 10:10:06.467950 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.467930 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 10:10:06.469075 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.469060 2559 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" May 26 10:10:06.477169 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.477153 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 26 10:10:06.799948 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:06.799872 2559 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 26 10:10:07.026542 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.026509 2559 apiserver.go:52] "Watching apiserver" May 26 10:10:07.031873 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.031852 2559 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 26 10:10:07.033416 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.033389 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz","openshift-cluster-node-tuning-operator/tuned-7p87f","openshift-image-registry/node-ca-ct4xd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-n5lkq","kube-system/konnectivity-agent-x8jvm","openshift-dns/node-resolver-b8wrj","openshift-multus/multus-kzcsg","openshift-multus/network-metrics-daemon-4rt42","openshift-network-diagnostics/network-check-target-rr5mj","openshift-network-operator/iptables-alerter-w4btp","openshift-ovn-kubernetes/ovnkube-node-h9rf2"] May 26 10:10:07.036259 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.036235 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.038337 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.038317 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.039119 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.039100 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9v8jf\"" May 26 10:10:07.039239 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.039174 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 26 10:10:07.039239 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.039225 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 26 10:10:07.040731 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.040236 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 26 10:10:07.040731 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.040338 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.040731 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.040358 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hb29\"" May 26 10:10:07.040731 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.040527 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 26 10:10:07.040949 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.040744 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 26 10:10:07.041819 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.041796 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:07.042251 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.041986 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 26 10:10:07.042251 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.042075 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6bpz\"" May 26 10:10:07.042590 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.042574 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.044732 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.044714 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.045407 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.045389 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 26 10:10:07.045492 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.045443 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xlthj\"" May 26 10:10:07.045553 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.045516 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 26 10:10:07.045553 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.045533 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 26 10:10:07.046843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.046821 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 26 10:10:07.046934 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.046901 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 26 10:10:07.046934 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.046908 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 26 10:10:07.047237 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.047218 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 26 10:10:07.047355 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.047226 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.047990 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.047961 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 26 10:10:07.048072 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.048037 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6kjfx\"" May 26 10:10:07.049058 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.049033 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 26 10:10:07.049151 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.049115 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-x6v6q\"" May 26 10:10:07.049208 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.049197 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 26 10:10:07.049514 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.049496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzcsg" May 26 10:10:07.051169 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.051129 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 26 10:10:07.051169 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.051133 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kczdw\"" May 26 10:10:07.053901 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.053882 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.053990 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.053977 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:07.054043 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.053974 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:07.054043 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.054031 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:07.056514 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.056496 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.058763 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.058742 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:07.058875 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.058857 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t4gn9\"" May 26 10:10:07.059250 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.059231 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 26 10:10:07.059332 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.059310 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 26 10:10:07.059403 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.059388 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.061478 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.061456 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-clwlh\"" May 26 10:10:07.061790 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.061712 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 26 10:10:07.061859 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.061834 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 26 10:10:07.061909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.061900 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 26 10:10:07.062349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.062088 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 26 10:10:07.062349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.062170 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 26 10:10:07.062349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.062245 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 26 10:10:07.064521 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064497 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-systemd\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.064616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064538 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-sys\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.064616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-etc-tuned\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.064616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064665 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-multus\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064714 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-etc-kubernetes\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064737 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.064793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrb2\" (UniqueName: \"kubernetes.io/projected/3b5a6113-a99d-4f42-91b0-afac5f987e52-kube-api-access-xwrb2\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-k8s-cni-cncf-io\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b676d847-6b34-44f6-9711-01aeaf62da49-konnectivity-ca\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064868 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5qv\" (UniqueName: \"kubernetes.io/projected/b389785e-acca-4d76-b4c1-4178957e3f6a-kube-api-access-4g5qv\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b5a6113-a99d-4f42-91b0-afac5f987e52-hosts-file\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064914 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-sys-fs\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-var-lib-kubelet\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.064978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-host\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-hostroot\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-multus-certs\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065053 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0484c9-1cdb-4bab-8408-1804b7965bb1-host\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-os-release\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065121 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc2tp\" (UniqueName: \"kubernetes.io/projected/6fbefb10-4116-48a8-948d-151f947b89f2-kube-api-access-gc2tp\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/7001fdea-2250-4548-90fa-a5f83f073fae-kube-api-access-fxv22\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-socket-dir-parent\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065200 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-cnibin\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065234 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdqr5\" (UniqueName: \"kubernetes.io/projected/911fd9ce-a15b-4db5-b7a1-200ce0e77759-kube-api-access-xdqr5\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065259 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-socket-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065299 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-tmp\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cni-binary-copy\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-bin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b676d847-6b34-44f6-9711-01aeaf62da49-agent-certs\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b5a6113-a99d-4f42-91b0-afac5f987e52-tmp-dir\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.065449 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48e3a220-d555-493d-a341-25016b6a8872-iptables-alerter-script\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065511 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0484c9-1cdb-4bab-8408-1804b7965bb1-serviceca\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cnibin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-os-release\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065577 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065601 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xggft\" (UniqueName: \"kubernetes.io/projected/e7a2478e-7b70-41ab-8a81-798d9a877cb6-kube-api-access-xggft\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-run\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065722 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-kubernetes\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065746 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysconfig\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065810 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-system-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065840 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-daemon-config\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065880 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-conf\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-registration-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065917 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-device-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.066064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065941 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-netns\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065963 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-kubelet\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.065987 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-lib-modules\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-conf-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066056 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwflq\" (UniqueName: \"kubernetes.io/projected/aa0484c9-1cdb-4bab-8408-1804b7965bb1-kube-api-access-fwflq\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066097 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48e3a220-d555-493d-a341-25016b6a8872-host-slash\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtwk\" (UniqueName: \"kubernetes.io/projected/48e3a220-d555-493d-a341-25016b6a8872-kube-api-access-zmtwk\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066217 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-modprobe-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.066662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.066270 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.155944 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.155914 2559 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 26 10:10:07.167363 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167326 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-socket-dir-parent\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.167363 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167374 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-cnibin\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167401 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdqr5\" (UniqueName: \"kubernetes.io/projected/911fd9ce-a15b-4db5-b7a1-200ce0e77759-kube-api-access-xdqr5\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-var-lib-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-ovn\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167482 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-socket-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-socket-dir-parent\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167516 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-tmp\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167541 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cni-binary-copy\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167565 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-bin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-cnibin\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.167589 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167591 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b676d847-6b34-44f6-9711-01aeaf62da49-agent-certs\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167607 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b5a6113-a99d-4f42-91b0-afac5f987e52-tmp-dir\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-systemd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167678 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167701 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48e3a220-d555-493d-a341-25016b6a8872-iptables-alerter-script\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167719 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovn-node-metrics-cert\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167766 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0484c9-1cdb-4bab-8408-1804b7965bb1-serviceca\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167783 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cnibin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167801 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-os-release\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167824 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167845 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167861 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xggft\" (UniqueName: \"kubernetes.io/projected/e7a2478e-7b70-41ab-8a81-798d9a877cb6-kube-api-access-xggft\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167879 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-slash\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.167978 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-netns\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168006 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-run\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168070 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168052 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-bin\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168094 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-kubernetes\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168115 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysconfig\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-system-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168167 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168186 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-daemon-config\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168202 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-conf\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-registration-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168254 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-device-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168278 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-netns\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168304 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-kubelet\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168329 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-systemd-units\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168400 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-lib-modules\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168421 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-conf-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168449 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwflq\" (UniqueName: \"kubernetes.io/projected/aa0484c9-1cdb-4bab-8408-1804b7965bb1-kube-api-access-fwflq\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.168827 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168449 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48e3a220-d555-493d-a341-25016b6a8872-iptables-alerter-script\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168468 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168499 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168525 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48e3a220-d555-493d-a341-25016b6a8872-host-slash\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168555 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtwk\" (UniqueName: \"kubernetes.io/projected/48e3a220-d555-493d-a341-25016b6a8872-kube-api-access-zmtwk\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168576 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-kubelet\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168593 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-modprobe-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168672 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-etc-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168696 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-netd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-env-overrides\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-script-lib\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168764 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-systemd\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168786 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-sys\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168827 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-etc-tuned\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168855 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168884 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.169617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168917 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cnibin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168942 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-node-log\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168980 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97hft\" (UniqueName: \"kubernetes.io/projected/324a060c-0fe6-4745-8d73-abfdf00ca20d-kube-api-access-97hft\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169001 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-multus\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169018 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-etc-kubernetes\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169046 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169066 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrb2\" (UniqueName: \"kubernetes.io/projected/3b5a6113-a99d-4f42-91b0-afac5f987e52-kube-api-access-xwrb2\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169067 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-socket-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169131 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-os-release\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169242 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-etc-kubernetes\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169319 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169351 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-multus\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysconfig\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169704 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-registration-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-cni-bin\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169777 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-system-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169834 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-cni-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169845 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169972 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-lib-modules\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-sysctl-conf\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.169997 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-cni-binary-copy\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-device-dir\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170097 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-netns\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-var-lib-kubelet\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170157 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-system-cni-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170192 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-run\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b5a6113-a99d-4f42-91b0-afac5f987e52-tmp-dir\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170603 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-cni-binary-copy\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-daemon-config\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48e3a220-d555-493d-a341-25016b6a8872-host-slash\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170721 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-kubernetes\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170732 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-log-socket\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.170908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170887 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170953 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-systemd\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-config\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.170988 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-k8s-cni-cncf-io\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b676d847-6b34-44f6-9711-01aeaf62da49-konnectivity-ca\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.171039 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171042 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5qv\" (UniqueName: \"kubernetes.io/projected/b389785e-acca-4d76-b4c1-4178957e3f6a-kube-api-access-4g5qv\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-multus-conf-dir\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171067 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b5a6113-a99d-4f42-91b0-afac5f987e52-hosts-file\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.168885 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/aa0484c9-1cdb-4bab-8408-1804b7965bb1-serviceca\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3b5a6113-a99d-4f42-91b0-afac5f987e52-hosts-file\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.171122 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:07.671090137 +0000 UTC m=+3.067199462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171170 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-sys-fs\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-var-lib-kubelet\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171213 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-etc-modprobe-d\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171228 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-host\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171276 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-hostroot\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.171726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-multus-certs\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171330 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0484c9-1cdb-4bab-8408-1804b7965bb1-host\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171386 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-os-release\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171419 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gc2tp\" (UniqueName: \"kubernetes.io/projected/6fbefb10-4116-48a8-948d-151f947b89f2-kube-api-access-gc2tp\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171441 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b389785e-acca-4d76-b4c1-4178957e3f6a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171460 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-sys\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171496 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/7001fdea-2250-4548-90fa-a5f83f073fae-kube-api-access-fxv22\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171524 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-host\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171526 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6fbefb10-4116-48a8-948d-151f947b89f2-sys-fs\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7001fdea-2250-4548-90fa-a5f83f073fae-var-lib-kubelet\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-hostroot\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171610 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-k8s-cni-cncf-io\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171612 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b389785e-acca-4d76-b4c1-4178957e3f6a-os-release\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa0484c9-1cdb-4bab-8408-1804b7965bb1-host\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e7a2478e-7b70-41ab-8a81-798d9a877cb6-host-run-multus-certs\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.172459 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.171799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b676d847-6b34-44f6-9711-01aeaf62da49-konnectivity-ca\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.173178 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.173161 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-tmp\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.173231 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.173184 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7001fdea-2250-4548-90fa-a5f83f073fae-etc-tuned\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.173426 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.173399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b676d847-6b34-44f6-9711-01aeaf62da49-agent-certs\") pod \"konnectivity-agent-x8jvm\" (UID: \"b676d847-6b34-44f6-9711-01aeaf62da49\") " pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.177345 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.177314 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 10:05:06 +0000 UTC" deadline="2027-12-29 16:00:24.958302503 +0000 UTC" May 26 10:10:07.177345 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.177344 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13973h50m17.780962471s" May 26 10:10:07.179139 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.179078 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:07.179139 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.179124 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:07.179139 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.179140 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:07.179475 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.179210 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:07.67919055 +0000 UTC m=+3.075299684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:07.182496 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.182470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrb2\" (UniqueName: \"kubernetes.io/projected/3b5a6113-a99d-4f42-91b0-afac5f987e52-kube-api-access-xwrb2\") pod \"node-resolver-b8wrj\" (UID: \"3b5a6113-a99d-4f42-91b0-afac5f987e52\") " pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.182695 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.182616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxv22\" (UniqueName: \"kubernetes.io/projected/7001fdea-2250-4548-90fa-a5f83f073fae-kube-api-access-fxv22\") pod \"tuned-7p87f\" (UID: \"7001fdea-2250-4548-90fa-a5f83f073fae\") " pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.183697 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.182727 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xggft\" (UniqueName: \"kubernetes.io/projected/e7a2478e-7b70-41ab-8a81-798d9a877cb6-kube-api-access-xggft\") pod \"multus-kzcsg\" (UID: \"e7a2478e-7b70-41ab-8a81-798d9a877cb6\") " pod="openshift-multus/multus-kzcsg" May 26 10:10:07.184971 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.182852 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdqr5\" (UniqueName: \"kubernetes.io/projected/911fd9ce-a15b-4db5-b7a1-200ce0e77759-kube-api-access-xdqr5\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.186786 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.186759 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtwk\" (UniqueName: \"kubernetes.io/projected/48e3a220-d555-493d-a341-25016b6a8872-kube-api-access-zmtwk\") pod \"iptables-alerter-w4btp\" (UID: \"48e3a220-d555-493d-a341-25016b6a8872\") " pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.187334 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.187309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwflq\" (UniqueName: \"kubernetes.io/projected/aa0484c9-1cdb-4bab-8408-1804b7965bb1-kube-api-access-fwflq\") pod \"node-ca-ct4xd\" (UID: \"aa0484c9-1cdb-4bab-8408-1804b7965bb1\") " pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.188023 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.187616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5qv\" (UniqueName: \"kubernetes.io/projected/b389785e-acca-4d76-b4c1-4178957e3f6a-kube-api-access-4g5qv\") pod \"multus-additional-cni-plugins-n5lkq\" (UID: \"b389785e-acca-4d76-b4c1-4178957e3f6a\") " pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.188023 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.187992 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc2tp\" (UniqueName: \"kubernetes.io/projected/6fbefb10-4116-48a8-948d-151f947b89f2-kube-api-access-gc2tp\") pod \"aws-ebs-csi-driver-node-g7svz\" (UID: \"6fbefb10-4116-48a8-948d-151f947b89f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.271880 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271837 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-systemd-units\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271893 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271925 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-kubelet\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271939 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-systemd-units\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271967 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-etc-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.271992 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-netd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272001 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272010 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-env-overrides\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-etc-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272007 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-kubelet\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272057 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-script-lib\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272084 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-netd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272090 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-node-log\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272108 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97hft\" (UniqueName: \"kubernetes.io/projected/324a060c-0fe6-4745-8d73-abfdf00ca20d-kube-api-access-97hft\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272125 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-log-socket\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-config\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272165 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-var-lib-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272179 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-ovn\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272198 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-systemd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272227 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272242 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovn-node-metrics-cert\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272261 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-slash\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272276 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-netns\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272294 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272330 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-bin\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-cni-bin\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.272501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-env-overrides\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272410 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-node-log\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272439 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272442 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-systemd\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272468 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-log-socket\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272686 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-script-lib\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272719 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-var-lib-openvswitch\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-slash\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-netns\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272761 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-run-ovn\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/324a060c-0fe6-4745-8d73-abfdf00ca20d-host-run-ovn-kubernetes\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.273126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.272821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovnkube-config\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.275177 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.275152 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/324a060c-0fe6-4745-8d73-abfdf00ca20d-ovn-node-metrics-cert\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.283768 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.283741 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97hft\" (UniqueName: \"kubernetes.io/projected/324a060c-0fe6-4745-8d73-abfdf00ca20d-kube-api-access-97hft\") pod \"ovnkube-node-h9rf2\" (UID: \"324a060c-0fe6-4745-8d73-abfdf00ca20d\") " pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.349149 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.349074 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:07.355923 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.355894 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" May 26 10:10:07.367725 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.367699 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7p87f" May 26 10:10:07.372463 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.372435 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ct4xd" May 26 10:10:07.379120 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.379099 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" May 26 10:10:07.386742 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.386719 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8wrj" May 26 10:10:07.393420 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.393399 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzcsg" May 26 10:10:07.401926 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.401904 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4btp" May 26 10:10:07.408565 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.408540 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:07.674741 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.674654 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:07.674890 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.674825 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:07.674954 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.674910 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:08.674886478 +0000 UTC m=+4.070995616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:07.776028 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:07.775982 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:07.776179 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.776131 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:07.776179 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.776153 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:07.776179 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.776162 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:07.776285 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:07.776220 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:08.776206794 +0000 UTC m=+4.172315922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:07.803425 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:07.803395 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb389785e_acca_4d76_b4c1_4178957e3f6a.slice/crio-64992bbabbdc860cf72f9aa432d91ebf54c5bc5a28f709ae360dea6639a576be WatchSource:0}: Error finding container 64992bbabbdc860cf72f9aa432d91ebf54c5bc5a28f709ae360dea6639a576be: Status 404 returned error can't find the container with id 64992bbabbdc860cf72f9aa432d91ebf54c5bc5a28f709ae360dea6639a576be May 26 10:10:07.804888 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:07.804855 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a2478e_7b70_41ab_8a81_798d9a877cb6.slice/crio-ce2e268b6d09994b5b091977087385c6e3b1eb19753654f34bd24eaeade24ebb WatchSource:0}: Error finding container ce2e268b6d09994b5b091977087385c6e3b1eb19753654f34bd24eaeade24ebb: Status 404 returned error can't find the container with id ce2e268b6d09994b5b091977087385c6e3b1eb19753654f34bd24eaeade24ebb May 26 10:10:07.805307 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:07.805244 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb676d847_6b34_44f6_9711_01aeaf62da49.slice/crio-5ae14f573ff84a4abe8dd52060f8e86a31d96d0f695bf023f02f8ddee4a068e9 WatchSource:0}: Error finding container 5ae14f573ff84a4abe8dd52060f8e86a31d96d0f695bf023f02f8ddee4a068e9: Status 404 returned error can't find the container with id 5ae14f573ff84a4abe8dd52060f8e86a31d96d0f695bf023f02f8ddee4a068e9 May 26 10:10:07.811679 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:07.811594 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5a6113_a99d_4f42_91b0_afac5f987e52.slice/crio-7636eeafc97d1ea81529b4730bb864dfa39d7d37ca2e69f8e48acea88c50ca15 WatchSource:0}: Error finding container 7636eeafc97d1ea81529b4730bb864dfa39d7d37ca2e69f8e48acea88c50ca15: Status 404 returned error can't find the container with id 7636eeafc97d1ea81529b4730bb864dfa39d7d37ca2e69f8e48acea88c50ca15 May 26 10:10:07.812684 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:07.812663 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324a060c_0fe6_4745_8d73_abfdf00ca20d.slice/crio-990879c7db815c56a3ffc607a5be40fd5df439eacaa1c6e8c4859b10e1cce4d9 WatchSource:0}: Error finding container 990879c7db815c56a3ffc607a5be40fd5df439eacaa1c6e8c4859b10e1cce4d9: Status 404 returned error can't find the container with id 990879c7db815c56a3ffc607a5be40fd5df439eacaa1c6e8c4859b10e1cce4d9 May 26 10:10:08.178171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.178123 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 10:05:06 +0000 UTC" deadline="2028-01-17 08:20:15.182799038 +0000 UTC" May 26 10:10:08.178171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.178166 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14422h10m7.004636389s" May 26 10:10:08.199488 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.199457 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:08.199629 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.199573 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:08.207314 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.207279 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" event={"ID":"6fbefb10-4116-48a8-948d-151f947b89f2","Type":"ContainerStarted","Data":"c790b4d7e497b6dc1223c210b9f802b19988bace21f92e1e58095a48ee2b265d"} May 26 10:10:08.208445 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.208414 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ct4xd" event={"ID":"aa0484c9-1cdb-4bab-8408-1804b7965bb1","Type":"ContainerStarted","Data":"54baf1c310cd4ff49b119c21ab549afad82ab0ae99eb64ad19f3bd54e6ffe4e8"} May 26 10:10:08.209678 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.209655 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4btp" event={"ID":"48e3a220-d555-493d-a341-25016b6a8872","Type":"ContainerStarted","Data":"9920cb68480c8a571dd47f165ebd2167a477f11b16e4a8a2d8f31a16819271a4"} May 26 10:10:08.211555 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.211521 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"990879c7db815c56a3ffc607a5be40fd5df439eacaa1c6e8c4859b10e1cce4d9"} May 26 10:10:08.214237 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.213345 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8wrj" event={"ID":"3b5a6113-a99d-4f42-91b0-afac5f987e52","Type":"ContainerStarted","Data":"7636eeafc97d1ea81529b4730bb864dfa39d7d37ca2e69f8e48acea88c50ca15"} May 26 10:10:08.216319 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.216297 2559 generic.go:358] "Generic (PLEG): container finished" podID="9a2fabbcd11a4c7d6877e6fc4f887e26" containerID="3d833bdf710949b832b093ccd7b8de2b9d0647fb69939f9e99b303a4fa77eb6b" exitCode=0 May 26 10:10:08.216434 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.216363 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"9a2fabbcd11a4c7d6877e6fc4f887e26","Type":"ContainerDied","Data":"3d833bdf710949b832b093ccd7b8de2b9d0647fb69939f9e99b303a4fa77eb6b"} May 26 10:10:08.219199 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.218171 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" event={"ID":"c4f0c297da793ecb55c38231a69a5ccb","Type":"ContainerStarted","Data":"fe340ace4915298e0a48832f7519f570bfc948f8efcfcd432dc749e37e78bfb0"} May 26 10:10:08.219848 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.219681 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7p87f" event={"ID":"7001fdea-2250-4548-90fa-a5f83f073fae","Type":"ContainerStarted","Data":"f5e39ec57674cae8f92bde59d118fd143cfddd093c36222b85b8e4cf147209ef"} May 26 10:10:08.220941 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.220914 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8jvm" event={"ID":"b676d847-6b34-44f6-9711-01aeaf62da49","Type":"ContainerStarted","Data":"5ae14f573ff84a4abe8dd52060f8e86a31d96d0f695bf023f02f8ddee4a068e9"} May 26 10:10:08.222963 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.222940 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzcsg" event={"ID":"e7a2478e-7b70-41ab-8a81-798d9a877cb6","Type":"ContainerStarted","Data":"ce2e268b6d09994b5b091977087385c6e3b1eb19753654f34bd24eaeade24ebb"} May 26 10:10:08.224113 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.224082 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerStarted","Data":"64992bbabbdc860cf72f9aa432d91ebf54c5bc5a28f709ae360dea6639a576be"} May 26 10:10:08.246372 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.246316 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-253.ec2.internal" podStartSLOduration=2.246297051 podStartE2EDuration="2.246297051s" podCreationTimestamp="2026-05-26 10:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:10:08.245621449 +0000 UTC m=+3.641730586" watchObservedRunningTime="2026-05-26 10:10:08.246297051 +0000 UTC m=+3.642406189" May 26 10:10:08.684399 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.684043 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:08.684583 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.684561 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:08.684722 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.684701 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:10.684619833 +0000 UTC m=+6.080728954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:08.785876 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:08.785838 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:08.786132 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.786114 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:08.786196 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.786138 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:08.786196 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.786153 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:08.786312 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:08.786217 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:10.786197359 +0000 UTC m=+6.182306497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:09.201294 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:09.201259 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:09.201783 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:09.201400 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:09.236616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:09.236580 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" event={"ID":"9a2fabbcd11a4c7d6877e6fc4f887e26","Type":"ContainerStarted","Data":"8c5cfcc70ff300242ff21cd3b1421e5581c12652deffb28bf35d4b51de7c834c"} May 26 10:10:10.200050 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:10.199483 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:10.200050 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.199596 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:10.706693 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:10.706355 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:10.706693 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.706514 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:10.706693 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.706575 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:14.706556076 +0000 UTC m=+10.102665209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:10.807157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:10.807111 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:10.807323 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.807282 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:10.807323 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.807301 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:10.807323 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.807312 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:10.807491 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:10.807373 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:14.807352752 +0000 UTC m=+10.203461881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:11.029338 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.029234 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-253.ec2.internal" podStartSLOduration=5.029214489 podStartE2EDuration="5.029214489s" podCreationTimestamp="2026-05-26 10:10:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:10:09.251922676 +0000 UTC m=+4.648031814" watchObservedRunningTime="2026-05-26 10:10:11.029214489 +0000 UTC m=+6.425323627" May 26 10:10:11.029520 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.029477 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wrzm5"] May 26 10:10:11.032461 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.032439 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.032602 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.032522 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:11.109324 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.109281 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.109485 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.109335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-kubelet-config\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.109485 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.109390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-dbus\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.199818 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.199786 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:11.199995 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.199931 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:11.210656 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.210605 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.210789 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.210669 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-kubelet-config\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.210789 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.210720 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-dbus\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.210934 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.210915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-dbus\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.211041 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.211027 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:11.211096 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.211085 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:11.711067622 +0000 UTC m=+7.107176754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:11.211335 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.211307 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a077b07-f576-4f58-b23c-893b3d173175-kubelet-config\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.715048 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:11.715016 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:11.715494 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.715154 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:11.715494 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:11.715200 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:12.715188214 +0000 UTC m=+8.111297329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:12.199884 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:12.199806 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:12.200048 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:12.199934 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:12.723506 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:12.723469 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:12.724016 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:12.723678 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:12.724016 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:12.723772 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:14.723726312 +0000 UTC m=+10.119835451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:13.199446 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:13.199362 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:13.199606 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:13.199491 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:13.199606 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:13.199548 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:13.199808 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:13.199673 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:14.199710 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:14.199673 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:14.200113 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.199813 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:14.740264 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:14.740226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:14.740526 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:14.740289 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:14.740526 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.740436 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:14.740526 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.740499 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:22.740479852 +0000 UTC m=+18.136588973 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:14.740993 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.740919 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:14.740993 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.740969 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:18.740955474 +0000 UTC m=+14.137064590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:14.841623 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:14.841580 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:14.841806 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.841747 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:14.841806 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.841774 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:14.841806 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.841789 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:14.841980 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:14.841849 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:22.841828404 +0000 UTC m=+18.237937520 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:15.200504 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:15.200398 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:15.200974 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:15.200523 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:15.200974 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:15.200925 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:15.201117 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:15.201020 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:16.199232 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:16.199149 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:16.199394 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:16.199286 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:17.199854 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:17.199818 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:17.200379 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:17.199821 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:17.200379 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:17.199927 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:17.200379 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:17.200008 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:18.199409 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:18.199377 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:18.199569 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:18.199495 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:18.772964 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:18.772923 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:18.773415 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:18.773098 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:18.773415 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:18.773168 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:26.773152809 +0000 UTC m=+22.169261938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:19.199580 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:19.199493 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:19.199580 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:19.199512 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:19.199799 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:19.199623 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:19.199799 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:19.199715 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:20.198953 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:20.198918 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:20.199349 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:20.199042 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:21.199826 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:21.199792 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:21.200261 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:21.199792 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:21.200261 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:21.199905 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:21.200261 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:21.200002 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:22.199701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:22.199666 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:22.199869 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.199776 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:22.802908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:22.802878 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:22.803100 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.803057 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:22.803161 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.803141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:38.803117198 +0000 UTC m=+34.199226328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:22.903692 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:22.903657 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:22.903890 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.903834 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:22.903890 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.903856 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:22.903890 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.903866 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:22.904045 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:22.903924 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:38.903908671 +0000 UTC m=+34.300017806 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:23.199222 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:23.199130 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:23.199222 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:23.199184 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:23.199448 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:23.199287 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:23.199448 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:23.199431 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:24.199503 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:24.199464 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:24.200095 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:24.199597 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:25.200433 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:25.200392 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:25.200903 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:25.200437 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:25.200903 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:25.200525 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:25.200903 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:25.200704 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:26.199263 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.199240 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:26.199377 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:26.199340 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:26.266413 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.266018 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8wrj" event={"ID":"3b5a6113-a99d-4f42-91b0-afac5f987e52","Type":"ContainerStarted","Data":"b03ed26de9427182f2df21bb9fcd3d992c28fa1674d9ea67de2bf4250dc166dd"} May 26 10:10:26.267326 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.267298 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x8jvm" event={"ID":"b676d847-6b34-44f6-9711-01aeaf62da49","Type":"ContainerStarted","Data":"581cc860da2a28401c8297a888b2c2b89008cfa2a13e1320800970cb8de1f42b"} May 26 10:10:26.268623 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.268594 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerStarted","Data":"0a10404e469af4b851cd33bc67faba582da1987f69eeab33dd9a3d97221c28c3"} May 26 10:10:26.269899 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.269869 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ct4xd" event={"ID":"aa0484c9-1cdb-4bab-8408-1804b7965bb1","Type":"ContainerStarted","Data":"9184804fc67bfda8a367ad40a6534ec26dc66ce59522637bb928f084816903dd"} May 26 10:10:26.282071 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.282028 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-b8wrj" podStartSLOduration=3.136468227 podStartE2EDuration="21.282016591s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.814424706 +0000 UTC m=+3.210533836" lastFinishedPulling="2026-05-26 10:10:25.959973081 +0000 UTC m=+21.356082200" observedRunningTime="2026-05-26 10:10:26.281668796 +0000 UTC m=+21.677777924" watchObservedRunningTime="2026-05-26 10:10:26.282016591 +0000 UTC m=+21.678125728" May 26 10:10:26.295808 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.295759 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x8jvm" podStartSLOduration=3.102895474 podStartE2EDuration="21.295745967s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.810380327 +0000 UTC m=+3.206489441" lastFinishedPulling="2026-05-26 10:10:26.003230819 +0000 UTC m=+21.399339934" observedRunningTime="2026-05-26 10:10:26.295274302 +0000 UTC m=+21.691383439" watchObservedRunningTime="2026-05-26 10:10:26.295745967 +0000 UTC m=+21.691855104" May 26 10:10:26.311606 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.311560 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ct4xd" podStartSLOduration=3.192422095 podStartE2EDuration="21.311547456s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.840849978 +0000 UTC m=+3.236959092" lastFinishedPulling="2026-05-26 10:10:25.959975324 +0000 UTC m=+21.356084453" observedRunningTime="2026-05-26 10:10:26.311060825 +0000 UTC m=+21.707169963" watchObservedRunningTime="2026-05-26 10:10:26.311547456 +0000 UTC m=+21.707656640" May 26 10:10:26.835573 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:26.835408 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:26.835573 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:26.835562 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 26 10:10:26.835754 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:26.835619 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret podName:1a077b07-f576-4f58-b23c-893b3d173175 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:42.835604546 +0000 UTC m=+38.231713674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret") pod "global-pull-secret-syncer-wrzm5" (UID: "1a077b07-f576-4f58-b23c-893b3d173175") : object "kube-system"/"original-pull-secret" not registered May 26 10:10:27.199130 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.199096 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:27.199341 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.199102 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:27.199341 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:27.199228 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:27.199438 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:27.199333 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:27.272608 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.272573 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" event={"ID":"6fbefb10-4116-48a8-948d-151f947b89f2","Type":"ContainerStarted","Data":"faf8931b510e450d9c887196195df555f283a7f71b83c860e6d7fedef00dfd4d"} May 26 10:10:27.276284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276263 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:10:27.276587 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276568 2559 generic.go:358] "Generic (PLEG): container finished" podID="324a060c-0fe6-4745-8d73-abfdf00ca20d" containerID="6c380b95f6877ce7906fe6a7ba0ee54445e079ad70bdf0e319db57ff737e80e9" exitCode=1 May 26 10:10:27.276675 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276647 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"b280edf7d7ea718e976f407909ff0d8ae4fe825239b3f2332c2fb41e5b765fe4"} May 26 10:10:27.276717 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276677 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"e207ce89b47b32a8aa06c3552125e4fc5c0a8a483c9f9e740f00cd6d0e1061eb"} May 26 10:10:27.276717 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276687 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"040c5453e3a5cd72b05d6d5edf1d954c1d28d497f226ab0d57a72e14c14c67f6"} May 26 10:10:27.276717 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276696 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"9e5664dc3748b7d19996020cdfddedc6f17209f2daa3fea9820dbf0a8ee0ec25"} May 26 10:10:27.276717 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276704 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerDied","Data":"6c380b95f6877ce7906fe6a7ba0ee54445e079ad70bdf0e319db57ff737e80e9"} May 26 10:10:27.276717 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.276717 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"526bcf6bff4b99bedcc201d7d3b7bb9d269870f5e858c2253c92c038937eed46"} May 26 10:10:27.277811 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.277784 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7p87f" event={"ID":"7001fdea-2250-4548-90fa-a5f83f073fae","Type":"ContainerStarted","Data":"faf9efd1e89bab3b6441e90d2f531449804e707f84e7ccb1212692a2d1016d08"} May 26 10:10:27.278933 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.278913 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzcsg" event={"ID":"e7a2478e-7b70-41ab-8a81-798d9a877cb6","Type":"ContainerStarted","Data":"d7389b559e8c1e851fc8297f9d1229e0744ef2f28ce8971fa889f53c445bc3a7"} May 26 10:10:27.280141 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.280121 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="0a10404e469af4b851cd33bc67faba582da1987f69eeab33dd9a3d97221c28c3" exitCode=0 May 26 10:10:27.280238 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.280222 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"0a10404e469af4b851cd33bc67faba582da1987f69eeab33dd9a3d97221c28c3"} May 26 10:10:27.294439 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.294399 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7p87f" podStartSLOduration=4.102617814 podStartE2EDuration="22.294388824s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.812767406 +0000 UTC m=+3.208876524" lastFinishedPulling="2026-05-26 10:10:26.004538414 +0000 UTC m=+21.400647534" observedRunningTime="2026-05-26 10:10:27.294315319 +0000 UTC m=+22.690424454" watchObservedRunningTime="2026-05-26 10:10:27.294388824 +0000 UTC m=+22.690497961" May 26 10:10:27.735037 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:27.735006 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 26 10:10:28.131898 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.131802 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T10:10:27.735034038Z","UUID":"61428e8c-c8f7-4615-8ec9-68e08f9467c7","Handler":null,"Name":"","Endpoint":""} May 26 10:10:28.133651 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.133599 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 26 10:10:28.133651 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.133650 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 26 10:10:28.199395 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.199363 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:28.199577 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:28.199475 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:28.285077 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.285037 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" event={"ID":"6fbefb10-4116-48a8-948d-151f947b89f2","Type":"ContainerStarted","Data":"cfad323acbfc7f2c38a676049561c90b2c60e3c81f287c4d1d38edab6489ea66"} May 26 10:10:28.288853 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.288812 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4btp" event={"ID":"48e3a220-d555-493d-a341-25016b6a8872","Type":"ContainerStarted","Data":"0c302890ac406c5f65a4b2b0340376118f4493cb6e2ab93769d1a618f515e32c"} May 26 10:10:28.306760 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.306705 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kzcsg" podStartSLOduration=5.0760186 podStartE2EDuration="23.306687093s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.808983524 +0000 UTC m=+3.205092641" lastFinishedPulling="2026-05-26 10:10:26.039652003 +0000 UTC m=+21.435761134" observedRunningTime="2026-05-26 10:10:27.331480974 +0000 UTC m=+22.727590102" watchObservedRunningTime="2026-05-26 10:10:28.306687093 +0000 UTC m=+23.702796232" May 26 10:10:28.306980 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:28.306955 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w4btp" podStartSLOduration=5.144400098 podStartE2EDuration="23.306947628s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.841232423 +0000 UTC m=+3.237341539" lastFinishedPulling="2026-05-26 10:10:26.003779954 +0000 UTC m=+21.399889069" observedRunningTime="2026-05-26 10:10:28.306558239 +0000 UTC m=+23.702667377" watchObservedRunningTime="2026-05-26 10:10:28.306947628 +0000 UTC m=+23.703056763" May 26 10:10:29.199582 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.199548 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:29.199738 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:29.199669 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:29.199803 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.199756 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:29.199889 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:29.199868 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:29.293380 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.293335 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" event={"ID":"6fbefb10-4116-48a8-948d-151f947b89f2","Type":"ContainerStarted","Data":"5f11f56a74c62787ae8929c184187a697758c75cebc4afb1ad7f6c2806d536fb"} May 26 10:10:29.296431 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.296391 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:10:29.296853 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.296814 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"e320d96691ddd08f5f0db017aa1592bbd8a5e6703a37958ba250e0d0a28182b6"} May 26 10:10:29.319329 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.319272 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g7svz" podStartSLOduration=3.459606645 podStartE2EDuration="24.319251639s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.84093967 +0000 UTC m=+3.237048790" lastFinishedPulling="2026-05-26 10:10:28.700584655 +0000 UTC m=+24.096693784" observedRunningTime="2026-05-26 10:10:29.318857748 +0000 UTC m=+24.714966886" watchObservedRunningTime="2026-05-26 10:10:29.319251639 +0000 UTC m=+24.715360798" May 26 10:10:29.476682 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.476644 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:29.477309 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:29.477286 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:30.199158 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:30.199119 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:30.199330 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:30.199227 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:30.298861 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:30.298829 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:30.299468 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:30.299445 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x8jvm" May 26 10:10:31.202701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.202316 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:31.202701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.202366 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:31.202701 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:31.202606 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:31.203159 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:31.202700 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:31.304174 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.304153 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:10:31.304545 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.304501 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"e776123e316c47963b39df00e3db5fb4962beb91054287f0eda8adf52e756c40"} May 26 10:10:31.304850 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.304827 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:31.304941 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.304883 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:31.304993 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.304962 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:31.305026 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.305013 2559 scope.go:117] "RemoveContainer" containerID="6c380b95f6877ce7906fe6a7ba0ee54445e079ad70bdf0e319db57ff737e80e9" May 26 10:10:31.324255 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.324223 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:31.326348 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:31.326322 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:10:32.199805 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:32.199757 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:32.199976 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:32.199903 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:32.310623 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:32.310595 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:10:32.311131 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:32.311037 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" event={"ID":"324a060c-0fe6-4745-8d73-abfdf00ca20d","Type":"ContainerStarted","Data":"4e32035b91bac41aebbe8bbd2b92a34dc41bfa375ecad7c5dd7e2f38c2687ec7"} May 26 10:10:32.343762 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:32.343705 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" podStartSLOduration=8.770156125 podStartE2EDuration="27.343690591s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.815070928 +0000 UTC m=+3.211180056" lastFinishedPulling="2026-05-26 10:10:26.388605391 +0000 UTC m=+21.784714522" observedRunningTime="2026-05-26 10:10:32.343401679 +0000 UTC m=+27.739510837" watchObservedRunningTime="2026-05-26 10:10:32.343690591 +0000 UTC m=+27.739799724" May 26 10:10:33.203131 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.203104 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:33.203316 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:33.203222 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:33.203720 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.203696 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:33.204043 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:33.203806 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:33.419737 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.419695 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrzm5"] May 26 10:10:33.420161 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.419816 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:33.420161 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:33.419955 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:33.426695 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.426663 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rr5mj"] May 26 10:10:33.426843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.426767 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:33.426900 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:33.426859 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:33.433937 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.433907 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4rt42"] May 26 10:10:33.434093 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:33.434015 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:33.434170 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:33.434131 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:34.316718 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:34.316477 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="01f30a38ba4dcdc8622b888b2cfcd3154dc62ecd2ee49e8c15aa1d5e22ea6574" exitCode=0 May 26 10:10:34.316718 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:34.316552 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"01f30a38ba4dcdc8622b888b2cfcd3154dc62ecd2ee49e8c15aa1d5e22ea6574"} May 26 10:10:35.199603 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:35.199571 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:35.200127 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:35.199681 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:35.200127 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:35.199689 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:35.200127 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:35.199815 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:35.200127 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:35.199840 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:35.200127 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:35.199939 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:36.322297 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:36.322260 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="b886998189ea92a5327bf1442e308990fa0d83e5410754e3788968480279656a" exitCode=0 May 26 10:10:36.322297 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:36.322300 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"b886998189ea92a5327bf1442e308990fa0d83e5410754e3788968480279656a"} May 26 10:10:37.199698 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:37.199665 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:37.199698 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:37.199695 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:37.199887 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:37.199678 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:37.199887 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:37.199784 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rr5mj" podUID="462c82f9-6340-4f2c-85dc-529b604247c8" May 26 10:10:37.199887 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:37.199844 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrzm5" podUID="1a077b07-f576-4f58-b23c-893b3d173175" May 26 10:10:37.200036 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:37.199922 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4rt42" podUID="911fd9ce-a15b-4db5-b7a1-200ce0e77759" May 26 10:10:38.328099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.327875 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="dc2fc076816c82b5e941967c75b04a063b434fe3b79b658d84085376c3da86f6" exitCode=0 May 26 10:10:38.328099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.327954 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"dc2fc076816c82b5e941967c75b04a063b434fe3b79b658d84085376c3da86f6"} May 26 10:10:38.830181 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.830144 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:38.830345 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.830317 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:38.830401 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.830389 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:10.830368484 +0000 UTC m=+66.226477616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : object "openshift-multus"/"metrics-daemon-secret" not registered May 26 10:10:38.903661 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.902730 2559 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-253.ec2.internal" event="NodeReady" May 26 10:10:38.903661 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.902892 2559 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 26 10:10:38.930800 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.930766 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:38.930972 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.930898 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 26 10:10:38.930972 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.930913 2559 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 26 10:10:38.930972 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.930922 2559 projected.go:194] Error preparing data for projected volume kube-api-access-ftmst for pod openshift-network-diagnostics/network-check-target-rr5mj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:38.931115 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:38.930979 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst podName:462c82f9-6340-4f2c-85dc-529b604247c8 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:10.930962216 +0000 UTC m=+66.327071334 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftmst" (UniqueName: "kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst") pod "network-check-target-rr5mj" (UID: "462c82f9-6340-4f2c-85dc-529b604247c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 26 10:10:38.975512 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.975434 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7"] May 26 10:10:38.987690 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.987660 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gvs8f"] May 26 10:10:38.987810 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.987749 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:38.989614 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.989595 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 26 10:10:38.989868 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.989842 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 26 10:10:38.989868 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.989844 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 26 10:10:38.990137 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.990122 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 26 10:10:38.990242 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.990223 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 26 10:10:38.990307 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.990233 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 26 10:10:38.990366 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.990331 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 26 10:10:38.998692 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.998672 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b"] May 26 10:10:38.998870 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:38.998845 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.001156 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.001137 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 26 10:10:39.001660 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.001625 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb2l8\"" May 26 10:10:39.001764 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.001690 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 26 10:10:39.001957 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.001937 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 26 10:10:39.012790 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.012763 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fbg7z"] May 26 10:10:39.012918 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.012906 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.015483 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.015459 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 26 10:10:39.016247 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.016228 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dp7lk\"" May 26 10:10:39.030746 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.030718 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:10:39.030863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.030850 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.034194 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.034167 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 26 10:10:39.034313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.034167 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 26 10:10:39.034313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.034216 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mm9pv\"" May 26 10:10:39.052906 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.052882 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7"] May 26 10:10:39.053054 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.053037 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.055515 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.055434 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 26 10:10:39.055515 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.055439 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 26 10:10:39.055515 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.055470 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 26 10:10:39.055757 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.055581 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smbnk\"" May 26 10:10:39.061031 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.060169 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 26 10:10:39.077038 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077007 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gvs8f"] May 26 10:10:39.077183 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077052 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fbg7z"] May 26 10:10:39.077183 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077069 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7"] May 26 10:10:39.077183 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077082 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.077325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077084 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:10:39.077325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077256 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b"] May 26 10:10:39.077325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.077280 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7"] May 26 10:10:39.079107 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.079083 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 26 10:10:39.131606 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131564 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.131606 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131812 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-tmp-dir\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.131863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131862 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbaebe9e-7c08-4c04-a561-ee625ed31879-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblrs\" (UniqueName: \"kubernetes.io/projected/dbaebe9e-7c08-4c04-a561-ee625ed31879-kube-api-access-gblrs\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.131949 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwdm\" (UniqueName: \"kubernetes.io/projected/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-kube-api-access-gtwdm\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.132033 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-config-volume\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.132074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gz66\" (UniqueName: \"kubernetes.io/projected/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-kube-api-access-9gz66\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.132144 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svpdw\" (UniqueName: \"kubernetes.io/projected/7acae325-51d9-4f45-8669-46262f25ccee-kube-api-access-svpdw\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.132189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.132174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.199745 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.199708 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:10:39.199745 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.199739 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:10:39.199944 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.199843 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:39.201567 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201545 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 10:10:39.201720 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201605 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 26 10:10:39.201793 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201764 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dpb8v\"" May 26 10:10:39.201844 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201836 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 26 10:10:39.201898 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201875 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4kp\"" May 26 10:10:39.201956 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.201941 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 26 10:10:39.233026 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.232959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgpps\" (UniqueName: \"kubernetes.io/projected/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-kube-api-access-kgpps\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.233026 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233004 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-svpdw\" (UniqueName: \"kubernetes.io/projected/7acae325-51d9-4f45-8669-46262f25ccee-kube-api-access-svpdw\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.233026 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.233208 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233100 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.233208 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233139 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.233208 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.233208 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.233177 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:39.233342 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.233233 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:10:39.73321443 +0000 UTC m=+35.129323546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:39.233342 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233177 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-tmp\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.233342 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233307 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.233445 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233342 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.233445 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233370 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233415 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233776 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233874 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.233907 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.233921 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.233990 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:39.733966235 +0000 UTC m=+35.130075370 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.234003 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.235198 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.234726 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235248 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-tmp-dir\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235303 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbaebe9e-7c08-4c04-a561-ee625ed31879-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235338 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gblrs\" (UniqueName: \"kubernetes.io/projected/dbaebe9e-7c08-4c04-a561-ee625ed31879-kube-api-access-gblrs\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235574 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwdm\" (UniqueName: \"kubernetes.io/projected/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-kube-api-access-gtwdm\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.236014 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.235877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-tmp-dir\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.236284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236136 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-config-volume\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.236284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236188 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.236284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.236284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gz66\" (UniqueName: \"kubernetes.io/projected/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-kube-api-access-9gz66\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.236465 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ms7t\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.238144 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.236747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-config-volume\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.239221 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.239196 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-ca\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.239330 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.239226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.240813 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.240786 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dbaebe9e-7c08-4c04-a561-ee625ed31879-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.240915 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.240791 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.241319 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.241236 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.241709 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.241690 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svpdw\" (UniqueName: \"kubernetes.io/projected/7acae325-51d9-4f45-8669-46262f25ccee-kube-api-access-svpdw\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.243297 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.243272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblrs\" (UniqueName: \"kubernetes.io/projected/dbaebe9e-7c08-4c04-a561-ee625ed31879-kube-api-access-gblrs\") pod \"managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b\" (UID: \"dbaebe9e-7c08-4c04-a561-ee625ed31879\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.244139 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.244091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwdm\" (UniqueName: \"kubernetes.io/projected/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-kube-api-access-gtwdm\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.244446 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.244426 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gz66\" (UniqueName: \"kubernetes.io/projected/89a1bfd6-35f7-4876-88c5-2a9c9a4a0398-kube-api-access-9gz66\") pod \"cluster-proxy-proxy-agent-8689499989-rbxc7\" (UID: \"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.310893 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.310856 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:10:39.326997 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.326966 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" May 26 10:10:39.337465 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337437 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337477 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337568 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337621 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337670 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337702 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ms7t\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337733 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kgpps\" (UniqueName: \"kubernetes.io/projected/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-kube-api-access-kgpps\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337782 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.337864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.337818 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.338668 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.338712 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-tmp\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.338973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.339268 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-tmp\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.339373 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.339388 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.339440 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:10:39.839422895 +0000 UTC m=+35.235532011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.339653 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.340450 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.340111 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.341516 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.341491 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.343000 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.342977 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.343148 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.343130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.348728 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.348708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgpps\" (UniqueName: \"kubernetes.io/projected/95dfe0a9-3c2d-4a49-98bb-932e3ff608f3-kube-api-access-kgpps\") pod \"klusterlet-addon-workmgr-6cc87dc49c-24zf7\" (UID: \"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.348816 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.348752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ms7t\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.349420 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.349403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.386661 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.386608 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:39.520015 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.519984 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b"] May 26 10:10:39.524769 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:39.524728 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbaebe9e_7c08_4c04_a561_ee625ed31879.slice/crio-b6a304a608c90f1ba1c1534b4c6f40c8854a4b2e84f8013f335c032b7c04d7a2 WatchSource:0}: Error finding container b6a304a608c90f1ba1c1534b4c6f40c8854a4b2e84f8013f335c032b7c04d7a2: Status 404 returned error can't find the container with id b6a304a608c90f1ba1c1534b4c6f40c8854a4b2e84f8013f335c032b7c04d7a2 May 26 10:10:39.526979 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.526922 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7"] May 26 10:10:39.529977 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:39.529951 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89a1bfd6_35f7_4876_88c5_2a9c9a4a0398.slice/crio-ecc181c24f592448664b72986d109dd6afb80e78807e7bf4beaf7cee10e59af7 WatchSource:0}: Error finding container ecc181c24f592448664b72986d109dd6afb80e78807e7bf4beaf7cee10e59af7: Status 404 returned error can't find the container with id ecc181c24f592448664b72986d109dd6afb80e78807e7bf4beaf7cee10e59af7 May 26 10:10:39.550807 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.550772 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7"] May 26 10:10:39.556223 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:39.556194 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95dfe0a9_3c2d_4a49_98bb_932e3ff608f3.slice/crio-b236d7ad15715b18053f434fb9d033fe611c9d77484d68de95df7d6a74d7570d WatchSource:0}: Error finding container b236d7ad15715b18053f434fb9d033fe611c9d77484d68de95df7d6a74d7570d: Status 404 returned error can't find the container with id b236d7ad15715b18053f434fb9d033fe611c9d77484d68de95df7d6a74d7570d May 26 10:10:39.743527 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.743442 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:39.743685 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.743528 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:39.743685 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.743679 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:39.743785 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.743774 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:40.743713911 +0000 UTC m=+36.139823025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:39.743852 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.743838 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:39.743919 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.743901 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:10:40.743882685 +0000 UTC m=+36.139991820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:39.845038 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:39.845000 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:39.845223 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.845159 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:39.845223 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.845182 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:39.845329 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:39.845251 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:10:40.845231781 +0000 UTC m=+36.241340916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:40.339996 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.339954 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" event={"ID":"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3","Type":"ContainerStarted","Data":"b236d7ad15715b18053f434fb9d033fe611c9d77484d68de95df7d6a74d7570d"} May 26 10:10:40.344388 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.344319 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" event={"ID":"dbaebe9e-7c08-4c04-a561-ee625ed31879","Type":"ContainerStarted","Data":"b6a304a608c90f1ba1c1534b4c6f40c8854a4b2e84f8013f335c032b7c04d7a2"} May 26 10:10:40.346235 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.346208 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerStarted","Data":"ecc181c24f592448664b72986d109dd6afb80e78807e7bf4beaf7cee10e59af7"} May 26 10:10:40.753246 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.753156 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:40.753418 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.753295 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:40.753489 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.753447 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:40.753539 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.753508 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:10:42.75348979 +0000 UTC m=+38.149598919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:40.754024 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.753938 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:40.754024 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.753991 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:42.753975586 +0000 UTC m=+38.150084704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:40.854537 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:40.853828 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:40.854537 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.854104 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:40.854537 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.854120 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:40.854537 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:40.854176 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:10:42.854157707 +0000 UTC m=+38.250266836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:42.773926 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:42.773666 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:42.774374 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:42.773979 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:42.774374 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.773833 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:42.774374 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.774168 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:10:46.774149073 +0000 UTC m=+42.170258213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:42.774552 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.774103 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:42.774604 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.774558 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:46.77454209 +0000 UTC m=+42.170651244 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:42.875181 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:42.875139 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:42.875375 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:42.875233 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:42.875375 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.875365 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:42.875486 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.875382 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:42.875486 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:42.875446 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:10:46.875428396 +0000 UTC m=+42.271537516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:42.879619 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:42.879585 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a077b07-f576-4f58-b23c-893b3d173175-original-pull-secret\") pod \"global-pull-secret-syncer-wrzm5\" (UID: \"1a077b07-f576-4f58-b23c-893b3d173175\") " pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:43.115799 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.115752 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrzm5" May 26 10:10:43.587195 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.587106 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pwk6b"] May 26 10:10:43.590900 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.590870 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.593680 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.593648 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-575fd68fbd-x59tq"] May 26 10:10:43.595765 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.595737 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" May 26 10:10:43.601669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.597933 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" May 26 10:10:43.601669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.598127 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:43.601669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.599018 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" May 26 10:10:43.601669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.599089 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6zh56\"" May 26 10:10:43.601669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.599509 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.621662 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.620433 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pwk6b"] May 26 10:10:43.625426 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.625369 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" May 26 10:10:43.625655 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.625578 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 26 10:10:43.627796 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.627773 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" May 26 10:10:43.633890 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.628539 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" May 26 10:10:43.634205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.630148 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-575fd68fbd-x59tq"] May 26 10:10:43.634318 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.630217 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zz949\"" May 26 10:10:43.634318 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.630290 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" May 26 10:10:43.634425 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.630323 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" May 26 10:10:43.634425 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.630360 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 26 10:10:43.682244 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-trusted-ca\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.682244 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682319 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-config\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-default-certificate\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682372 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxwg\" (UniqueName: \"kubernetes.io/projected/0f4289b5-0a91-47bf-94a9-596d42576100-kube-api-access-8gxwg\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lnl4\" (UniqueName: \"kubernetes.io/projected/69c25770-d860-4c8c-8965-ab8bf02cd2b6-kube-api-access-9lnl4\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.682476 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682472 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-stats-auth\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.682733 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.682545 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c25770-d860-4c8c-8965-ab8bf02cd2b6-serving-cert\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.688401 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.688359 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm"] May 26 10:10:43.691672 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.691645 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk"] May 26 10:10:43.691821 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.691785 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.694005 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.693982 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" May 26 10:10:43.694313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.694294 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" May 26 10:10:43.694515 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.694498 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjl85\"" May 26 10:10:43.695750 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.695730 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw"] May 26 10:10:43.695884 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.695868 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.697617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.697600 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jz79w\"" May 26 10:10:43.697757 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.697740 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:43.697818 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.697788 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" May 26 10:10:43.697905 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.697889 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" May 26 10:10:43.698199 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.698183 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" May 26 10:10:43.699969 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.699951 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c"] May 26 10:10:43.700186 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.700168 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" May 26 10:10:43.703425 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.703404 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-tvk6f\"" May 26 10:10:43.704178 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.704159 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wxcx9"] May 26 10:10:43.704314 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.704298 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.707238 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.707218 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:43.707340 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.707320 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" May 26 10:10:43.707395 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.707357 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-62sp9\"" May 26 10:10:43.707591 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.707570 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" May 26 10:10:43.707742 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.707575 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.710736 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm"] May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.710763 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk"] May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.710775 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw"] May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.710782 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wxcx9"] May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.710900 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.711780 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.711277 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c"] May 26 10:10:43.712745 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.712723 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-p9jrc\"" May 26 10:10:43.712864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.712820 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" May 26 10:10:43.712932 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.712876 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 26 10:10:43.714539 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.713024 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 26 10:10:43.714539 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.713300 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" May 26 10:10:43.728950 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.728923 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" May 26 10:10:43.783865 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psbgt\" (UniqueName: \"kubernetes.io/projected/c777765b-fa37-43c3-9b31-225bf12c1e56-kube-api-access-psbgt\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.783865 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c777765b-fa37-43c3-9b31-225bf12c1e56-config\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783907 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783934 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/33dea431-277f-44e6-8ee4-bbd8f389ebf3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783961 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4534f1-7047-4944-b6f6-ecea9352ed74-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.783991 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-config\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784050 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-default-certificate\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784093 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxwg\" (UniqueName: \"kubernetes.io/projected/0f4289b5-0a91-47bf-94a9-596d42576100-kube-api-access-8gxwg\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784112 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxfs\" (UniqueName: \"kubernetes.io/projected/3f4534f1-7047-4944-b6f6-ecea9352ed74-kube-api-access-pzxfs\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784165 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9lnl4\" (UniqueName: \"kubernetes.io/projected/69c25770-d860-4c8c-8965-ab8bf02cd2b6-kube-api-access-9lnl4\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.784302 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.284281796 +0000 UTC m=+39.680390925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-stats-auth\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.784349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f4534f1-7047-4944-b6f6-ecea9352ed74-config\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-tmp\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784440 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c25770-d860-4c8c-8965-ab8bf02cd2b6-serving-cert\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784476 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-trusted-ca\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784527 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glvq6\" (UniqueName: \"kubernetes.io/projected/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-kube-api-access-glvq6\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.784600 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784627 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-config\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.784659 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.284627772 +0000 UTC m=+39.680736888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42226\" (UniqueName: \"kubernetes.io/projected/e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740-kube-api-access-42226\") pod \"network-check-source-7f44b6dd87-sm4mw\" (UID: \"e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784757 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c777765b-fa37-43c3-9b31-225bf12c1e56-serving-cert\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784780 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-snapshots\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.785008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.784849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-serving-cert\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.786602 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.785424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/69c25770-d860-4c8c-8965-ab8bf02cd2b6-trusted-ca\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.786740 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.786669 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c"] May 26 10:10:43.787471 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.787451 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-default-certificate\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.788095 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.788063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-stats-auth\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.788332 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.788312 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69c25770-d860-4c8c-8965-ab8bf02cd2b6-serving-cert\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.801954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.801919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lnl4\" (UniqueName: \"kubernetes.io/projected/69c25770-d860-4c8c-8965-ab8bf02cd2b6-kube-api-access-9lnl4\") pod \"console-operator-76dff48d59-pwk6b\" (UID: \"69c25770-d860-4c8c-8965-ab8bf02cd2b6\") " pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.802082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.801986 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxwg\" (UniqueName: \"kubernetes.io/projected/0f4289b5-0a91-47bf-94a9-596d42576100-kube-api-access-8gxwg\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:43.818736 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.818709 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5"] May 26 10:10:43.818877 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.818858 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" May 26 10:10:43.820982 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.820953 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:43.821107 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.821000 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v97bd\"" May 26 10:10:43.821157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.821146 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" May 26 10:10:43.848548 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.848468 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv"] May 26 10:10:43.848715 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.848688 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:43.850911 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.850891 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" May 26 10:10:43.851049 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.850946 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" May 26 10:10:43.851049 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.850899 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjqbj\"" May 26 10:10:43.851156 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.851088 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" May 26 10:10:43.879869 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.879834 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c"] May 26 10:10:43.879869 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.879878 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5"] May 26 10:10:43.880104 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.879888 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv"] May 26 10:10:43.880104 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.879949 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:43.882312 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.882284 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" May 26 10:10:43.882312 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.882303 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wgxc7\"" May 26 10:10:43.882508 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.882316 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 26 10:10:43.882508 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.882339 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 26 10:10:43.883043 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.883024 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" May 26 10:10:43.885481 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885458 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxfs\" (UniqueName: \"kubernetes.io/projected/3f4534f1-7047-4944-b6f6-ecea9352ed74-kube-api-access-pzxfs\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.885585 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885492 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f4534f1-7047-4944-b6f6-ecea9352ed74-config\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.885585 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885533 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-tmp\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885585 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885574 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885713 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885597 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:43.885713 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885612 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt44j\" (UniqueName: \"kubernetes.io/projected/c24acf33-10e5-4658-9071-5d179dd36d3e-kube-api-access-pt44j\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:43.885713 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885663 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glvq6\" (UniqueName: \"kubernetes.io/projected/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-kube-api-access-glvq6\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885713 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmghn\" (UniqueName: \"kubernetes.io/projected/d352782c-b47e-4243-87e4-d7112b6c7172-kube-api-access-pmghn\") pod \"volume-data-source-validator-5cf8c89d64-h7s5c\" (UID: \"d352782c-b47e-4243-87e4-d7112b6c7172\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885715 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885748 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42226\" (UniqueName: \"kubernetes.io/projected/e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740-kube-api-access-42226\") pod \"network-check-source-7f44b6dd87-sm4mw\" (UID: \"e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885764 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c777765b-fa37-43c3-9b31-225bf12c1e56-serving-cert\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885779 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-snapshots\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885802 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-serving-cert\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885827 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psbgt\" (UniqueName: \"kubernetes.io/projected/c777765b-fa37-43c3-9b31-225bf12c1e56-kube-api-access-psbgt\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885847 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c777765b-fa37-43c3-9b31-225bf12c1e56-config\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885870 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885889 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/33dea431-277f-44e6-8ee4-bbd8f389ebf3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.885909 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.885908 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4534f1-7047-4944-b6f6-ecea9352ed74-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.887318 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.887298 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:43.887433 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.887361 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.387343262 +0000 UTC m=+39.783452395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.888592 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f4534f1-7047-4944-b6f6-ecea9352ed74-config\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.888605 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-tmp\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-service-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889151 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889280 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c777765b-fa37-43c3-9b31-225bf12c1e56-config\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.889428 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f4534f1-7047-4944-b6f6-ecea9352ed74-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.889822 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/33dea431-277f-44e6-8ee4-bbd8f389ebf3-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:43.889822 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.889772 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-snapshots\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.890908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.890883 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c777765b-fa37-43c3-9b31-225bf12c1e56-serving-cert\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.891990 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.891949 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-serving-cert\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.899199 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.898851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psbgt\" (UniqueName: \"kubernetes.io/projected/c777765b-fa37-43c3-9b31-225bf12c1e56-kube-api-access-psbgt\") pod \"service-ca-operator-57b5b68b8-c6zlk\" (UID: \"c777765b-fa37-43c3-9b31-225bf12c1e56\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:43.899199 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.898982 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42226\" (UniqueName: \"kubernetes.io/projected/e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740-kube-api-access-42226\") pod \"network-check-source-7f44b6dd87-sm4mw\" (UID: \"e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" May 26 10:10:43.899885 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.899865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxfs\" (UniqueName: \"kubernetes.io/projected/3f4534f1-7047-4944-b6f6-ecea9352ed74-kube-api-access-pzxfs\") pod \"kube-storage-version-migrator-operator-565644f49-74z5c\" (UID: \"3f4534f1-7047-4944-b6f6-ecea9352ed74\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:43.899991 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.899956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glvq6\" (UniqueName: \"kubernetes.io/projected/2a1fd620-8f7d-4adf-82da-7cb70a76dd64-kube-api-access-glvq6\") pod \"insights-operator-78bdfb888c-wxcx9\" (UID: \"2a1fd620-8f7d-4adf-82da-7cb70a76dd64\") " pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:43.931750 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.931714 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:10:43.987024 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.986989 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:43.987024 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.987027 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pt44j\" (UniqueName: \"kubernetes.io/projected/c24acf33-10e5-4658-9071-5d179dd36d3e-kube-api-access-pt44j\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:43.987234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.987070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:43.987234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.987098 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmghn\" (UniqueName: \"kubernetes.io/projected/d352782c-b47e-4243-87e4-d7112b6c7172-kube-api-access-pmghn\") pod \"volume-data-source-validator-5cf8c89d64-h7s5c\" (UID: \"d352782c-b47e-4243-87e4-d7112b6c7172\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" May 26 10:10:43.987234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.987134 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7049ba-f170-4304-887a-66edfeb9b779-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:43.987234 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.987134 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:43.987234 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:43.987224 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.487206286 +0000 UTC m=+39.883315401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:10:43.987451 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.987277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnml2\" (UniqueName: \"kubernetes.io/projected/dc7049ba-f170-4304-887a-66edfeb9b779-kube-api-access-fnml2\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:43.997731 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.997705 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmghn\" (UniqueName: \"kubernetes.io/projected/d352782c-b47e-4243-87e4-d7112b6c7172-kube-api-access-pmghn\") pod \"volume-data-source-validator-5cf8c89d64-h7s5c\" (UID: \"d352782c-b47e-4243-87e4-d7112b6c7172\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" May 26 10:10:43.997892 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:43.997872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt44j\" (UniqueName: \"kubernetes.io/projected/c24acf33-10e5-4658-9071-5d179dd36d3e-kube-api-access-pt44j\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:44.018214 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.018187 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" May 26 10:10:44.033103 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.033082 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" May 26 10:10:44.040740 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.040721 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" May 26 10:10:44.046319 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.046297 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" May 26 10:10:44.088228 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.088196 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.088228 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.088231 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7049ba-f170-4304-887a-66edfeb9b779-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.088412 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.088283 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnml2\" (UniqueName: \"kubernetes.io/projected/dc7049ba-f170-4304-887a-66edfeb9b779-kube-api-access-fnml2\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.088412 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.088327 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:44.088412 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.088392 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:44.588374382 +0000 UTC m=+39.984483511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:44.088935 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.088918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/dc7049ba-f170-4304-887a-66edfeb9b779-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.105468 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.105399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnml2\" (UniqueName: \"kubernetes.io/projected/dc7049ba-f170-4304-887a-66edfeb9b779-kube-api-access-fnml2\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.130325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.130284 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" May 26 10:10:44.290064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.290021 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:44.290211 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.290159 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:44.290211 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.290180 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.290163926 +0000 UTC m=+40.686273043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:44.290332 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.290254 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:44.290332 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.290308 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.290293055 +0000 UTC m=+40.686402188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:44.391057 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.390972 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:44.391230 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.391130 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:44.391290 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.391256 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.391240482 +0000 UTC m=+40.787349597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:44.492121 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.492078 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:44.492308 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.492204 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:44.492308 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.492299 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.492276674 +0000 UTC m=+40.888385806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:10:44.593350 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:44.593311 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:44.593493 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.593457 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:44.593534 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:44.593520 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:45.593504301 +0000 UTC m=+40.989613419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:45.301155 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:45.301115 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:45.301551 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:45.301226 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:45.301551 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.301293 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.301273676 +0000 UTC m=+42.697382796 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:45.301551 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.301371 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:45.301551 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.301435 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.301422093 +0000 UTC m=+42.697531231 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:45.402486 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:45.402438 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:45.402629 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.402582 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:45.402711 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.402674 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.402652451 +0000 UTC m=+42.798761587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:45.503732 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:45.503685 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:45.503889 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.503869 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:45.503971 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.503948 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.503926377 +0000 UTC m=+42.900035496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:10:45.604840 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:45.604759 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:45.604991 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.604923 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:45.605031 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:45.604996 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:47.604975038 +0000 UTC m=+43.001084153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:46.818136 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:46.818083 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:46.818605 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:46.818194 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:46.818605 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.818253 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:46.818605 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.818303 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:46.818605 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.818321 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:54.818302471 +0000 UTC m=+50.214411587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:46.818605 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.818352 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:10:54.818338006 +0000 UTC m=+50.214447145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:46.918968 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:46.918923 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:46.919131 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.919091 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:46.919131 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.919116 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:46.919227 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:46.919181 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:10:54.919160233 +0000 UTC m=+50.315269353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:47.322807 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:47.322772 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:47.323056 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:47.322894 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:47.323056 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.322931 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:47.323056 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.323011 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.322990371 +0000 UTC m=+46.719099497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:47.323056 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.323033 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.323022426 +0000 UTC m=+46.719131544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:47.424095 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:47.424058 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:47.424276 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.424206 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:47.424276 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.424274 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.424254892 +0000 UTC m=+46.820364035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:47.525348 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:47.525305 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:47.525511 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.525465 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:47.525574 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.525538 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.525521843 +0000 UTC m=+46.921630957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:10:47.625928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:47.625901 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:47.626070 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.626054 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:47.626131 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:47.626122 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:51.626104073 +0000 UTC m=+47.022213195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:49.203245 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.200525 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw"] May 26 10:10:49.228409 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.226577 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-pwk6b"] May 26 10:10:49.230006 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.229754 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c"] May 26 10:10:49.238900 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.236941 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrzm5"] May 26 10:10:49.359556 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.359526 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41aa6e3_74c7_4a61_92d0_ce5a1c0e0740.slice/crio-530ddb310cd8c6a9450a51612947e331de15c4d501a7b948c36bf2b3e5108465 WatchSource:0}: Error finding container 530ddb310cd8c6a9450a51612947e331de15c4d501a7b948c36bf2b3e5108465: Status 404 returned error can't find the container with id 530ddb310cd8c6a9450a51612947e331de15c4d501a7b948c36bf2b3e5108465 May 26 10:10:49.360301 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.359965 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c25770_d860_4c8c_8965_ab8bf02cd2b6.slice/crio-d20d1fb391b8fa9f1bff0344985ce72ee93e8c3f9f7c7b613ba3a25089e48c35 WatchSource:0}: Error finding container d20d1fb391b8fa9f1bff0344985ce72ee93e8c3f9f7c7b613ba3a25089e48c35: Status 404 returned error can't find the container with id d20d1fb391b8fa9f1bff0344985ce72ee93e8c3f9f7c7b613ba3a25089e48c35 May 26 10:10:49.360946 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.360869 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f4534f1_7047_4944_b6f6_ecea9352ed74.slice/crio-d23a44e425c4594be28525f096478754817c53865d0153310fe55b28ebe5a8f5 WatchSource:0}: Error finding container d23a44e425c4594be28525f096478754817c53865d0153310fe55b28ebe5a8f5: Status 404 returned error can't find the container with id d23a44e425c4594be28525f096478754817c53865d0153310fe55b28ebe5a8f5 May 26 10:10:49.362492 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.362061 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a077b07_f576_4f58_b23c_893b3d173175.slice/crio-48492782f77256f3df8ee2fc3842388690a85eaeaa73da278557795129b8669e WatchSource:0}: Error finding container 48492782f77256f3df8ee2fc3842388690a85eaeaa73da278557795129b8669e: Status 404 returned error can't find the container with id 48492782f77256f3df8ee2fc3842388690a85eaeaa73da278557795129b8669e May 26 10:10:49.364600 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.364566 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" event={"ID":"e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740","Type":"ContainerStarted","Data":"530ddb310cd8c6a9450a51612947e331de15c4d501a7b948c36bf2b3e5108465"} May 26 10:10:49.367248 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.367225 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerStarted","Data":"849fd477de27afa322f685f73eeb3ae9c7c64d964a4a3ec500d5bca2d100d22c"} May 26 10:10:49.368467 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.368441 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" event={"ID":"69c25770-d860-4c8c-8965-ab8bf02cd2b6","Type":"ContainerStarted","Data":"d20d1fb391b8fa9f1bff0344985ce72ee93e8c3f9f7c7b613ba3a25089e48c35"} May 26 10:10:49.369621 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.369601 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" event={"ID":"dbaebe9e-7c08-4c04-a561-ee625ed31879","Type":"ContainerStarted","Data":"b2375b453a615379dc2f80a3637e2843ca42641717ff93567232540c8738177d"} May 26 10:10:49.371157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.371135 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerStarted","Data":"b07249a75452f5f33bf7dbdbfe04c72f8cbb8040f14ef27e823255bccef65a43"} May 26 10:10:49.372387 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.372359 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" event={"ID":"3f4534f1-7047-4944-b6f6-ecea9352ed74","Type":"ContainerStarted","Data":"d23a44e425c4594be28525f096478754817c53865d0153310fe55b28ebe5a8f5"} May 26 10:10:49.403953 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.403906 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f77d7fd64-6jg4b" podStartSLOduration=30.033316488 podStartE2EDuration="39.403890596s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:39.528238628 +0000 UTC m=+34.924347758" lastFinishedPulling="2026-05-26 10:10:48.898812737 +0000 UTC m=+44.294921866" observedRunningTime="2026-05-26 10:10:49.403512311 +0000 UTC m=+44.799621449" watchObservedRunningTime="2026-05-26 10:10:49.403890596 +0000 UTC m=+44.799999747" May 26 10:10:49.458229 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.458205 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c"] May 26 10:10:49.466726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.466579 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-wxcx9"] May 26 10:10:49.469598 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:49.469565 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk"] May 26 10:10:49.479950 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.479919 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a1fd620_8f7d_4adf_82da_7cb70a76dd64.slice/crio-91fa081682a5bfcd61166faaed2ff3eb9440ac80878a8a7b97ef0dd97a0747f8 WatchSource:0}: Error finding container 91fa081682a5bfcd61166faaed2ff3eb9440ac80878a8a7b97ef0dd97a0747f8: Status 404 returned error can't find the container with id 91fa081682a5bfcd61166faaed2ff3eb9440ac80878a8a7b97ef0dd97a0747f8 May 26 10:10:49.480128 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.480107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc777765b_fa37_43c3_9b31_225bf12c1e56.slice/crio-1f230803f944f2232249180651cc1946babcee33fee86aab7eb6c8cda8b29ecf WatchSource:0}: Error finding container 1f230803f944f2232249180651cc1946babcee33fee86aab7eb6c8cda8b29ecf: Status 404 returned error can't find the container with id 1f230803f944f2232249180651cc1946babcee33fee86aab7eb6c8cda8b29ecf May 26 10:10:49.480453 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:10:49.480431 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd352782c_b47e_4243_87e4_d7112b6c7172.slice/crio-20bfe243ee1ad034b7fb1f88d06b6571147e0b35f28e1af5f239185913d5f587 WatchSource:0}: Error finding container 20bfe243ee1ad034b7fb1f88d06b6571147e0b35f28e1af5f239185913d5f587: Status 404 returned error can't find the container with id 20bfe243ee1ad034b7fb1f88d06b6571147e0b35f28e1af5f239185913d5f587 May 26 10:10:50.381152 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.380102 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="849fd477de27afa322f685f73eeb3ae9c7c64d964a4a3ec500d5bca2d100d22c" exitCode=0 May 26 10:10:50.381152 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.380180 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"849fd477de27afa322f685f73eeb3ae9c7c64d964a4a3ec500d5bca2d100d22c"} May 26 10:10:50.388873 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.388034 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" event={"ID":"95dfe0a9-3c2d-4a49-98bb-932e3ff608f3","Type":"ContainerStarted","Data":"c0a03ce4544fe1f785310740bb51b1bdd632069465b75fddeb6e981e2e52cd67"} May 26 10:10:50.388873 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.388825 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:50.391313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.391278 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" May 26 10:10:50.394053 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.394028 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" event={"ID":"2a1fd620-8f7d-4adf-82da-7cb70a76dd64","Type":"ContainerStarted","Data":"91fa081682a5bfcd61166faaed2ff3eb9440ac80878a8a7b97ef0dd97a0747f8"} May 26 10:10:50.402313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.402281 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrzm5" event={"ID":"1a077b07-f576-4f58-b23c-893b3d173175","Type":"ContainerStarted","Data":"48492782f77256f3df8ee2fc3842388690a85eaeaa73da278557795129b8669e"} May 26 10:10:50.411583 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.411558 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" event={"ID":"c777765b-fa37-43c3-9b31-225bf12c1e56","Type":"ContainerStarted","Data":"1f230803f944f2232249180651cc1946babcee33fee86aab7eb6c8cda8b29ecf"} May 26 10:10:50.413903 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.413880 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" event={"ID":"d352782c-b47e-4243-87e4-d7112b6c7172","Type":"ContainerStarted","Data":"20bfe243ee1ad034b7fb1f88d06b6571147e0b35f28e1af5f239185913d5f587"} May 26 10:10:50.418881 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:50.418686 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cc87dc49c-24zf7" podStartSLOduration=30.580752986 podStartE2EDuration="40.418671687s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:39.558379014 +0000 UTC m=+34.954488130" lastFinishedPulling="2026-05-26 10:10:49.396297714 +0000 UTC m=+44.792406831" observedRunningTime="2026-05-26 10:10:50.417553201 +0000 UTC m=+45.813662339" watchObservedRunningTime="2026-05-26 10:10:50.418671687 +0000 UTC m=+45.814780826" May 26 10:10:51.372819 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.372777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:51.373023 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.372922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:51.373093 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.373072 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:51.373156 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.373139 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.373117305 +0000 UTC m=+54.769226430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:51.373526 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.373502 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.373483658 +0000 UTC m=+54.769592780 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:51.433337 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.431951 2559 generic.go:358] "Generic (PLEG): container finished" podID="b389785e-acca-4d76-b4c1-4178957e3f6a" containerID="b58d6d1e635499ec7eaaeaeee89e464e39352d1130e953e9f35514160f789a22" exitCode=0 May 26 10:10:51.433337 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.433105 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerDied","Data":"b58d6d1e635499ec7eaaeaeee89e464e39352d1130e953e9f35514160f789a22"} May 26 10:10:51.475932 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.474028 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:51.475932 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.474171 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:51.475932 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.474233 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.474214409 +0000 UTC m=+54.870323526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:51.575748 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.574984 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:51.575748 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.575284 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:51.575748 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.575353 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.575334647 +0000 UTC m=+54.971443768 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:10:51.676707 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:51.675856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:51.676707 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.676084 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:51.676707 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:51.676152 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:10:59.676131637 +0000 UTC m=+55.072240775 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:54.909572 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:54.909518 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:10:54.910086 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:54.909717 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:10:54.910086 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:54.909787 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:11:10.909770618 +0000 UTC m=+66.305879738 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:10:54.910086 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:54.909822 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:10:54.910086 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:54.909944 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 26 10:10:54.910086 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:54.909970 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls podName:60d9ffbe-34f5-49be-bf7c-3919d8e6bc26 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:10.909963511 +0000 UTC m=+66.306072626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls") pod "dns-default-fbg7z" (UID: "60d9ffbe-34f5-49be-bf7c-3919d8e6bc26") : secret "dns-default-metrics-tls" not found May 26 10:10:55.010687 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:55.010626 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:10:55.010849 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:55.010782 2559 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 26 10:10:55.010849 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:55.010801 2559 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6856f957f-qknnb: secret "image-registry-tls" not found May 26 10:10:55.010930 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:55.010856 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls podName:9a6ca47b-b6d0-4785-876e-0f20565b6abb nodeName:}" failed. No retries permitted until 2026-05-26 10:11:11.010842416 +0000 UTC m=+66.406951532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls") pod "image-registry-6856f957f-qknnb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb") : secret "image-registry-tls" not found May 26 10:10:59.464726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.464099 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:59.464726 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.464224 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:10:59.464726 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.464391 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found May 26 10:10:59.464726 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.464447 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.464429409 +0000 UTC m=+70.860538524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : secret "router-metrics-certs-default" not found May 26 10:10:59.464726 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.464514 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle podName:0f4289b5-0a91-47bf-94a9-596d42576100 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.464504985 +0000 UTC m=+70.860614100 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle") pod "router-default-575fd68fbd-x59tq" (UID: "0f4289b5-0a91-47bf-94a9-596d42576100") : configmap references non-existent config key: service-ca.crt May 26 10:10:59.465883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.465537 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" event={"ID":"e41aa6e3-74c7-4a61-92d0-ce5a1c0e0740","Type":"ContainerStarted","Data":"7881ce6103b9885931b5f628281eec5186bde7ffcba636baeff145c59442ea7a"} May 26 10:10:59.475140 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.475110 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" event={"ID":"b389785e-acca-4d76-b4c1-4178957e3f6a","Type":"ContainerStarted","Data":"4144e4bee07aebe4afc99455fb95c6b93f123a44e106fefb4b4bb600495f3f6b"} May 26 10:10:59.477732 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.477684 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" event={"ID":"69c25770-d860-4c8c-8965-ab8bf02cd2b6","Type":"ContainerStarted","Data":"2a588dda9824a5fd11aa8834f283d99b0d1eeebbcd3e61a0ffe766614676784d"} May 26 10:10:59.480699 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.480202 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" event={"ID":"2a1fd620-8f7d-4adf-82da-7cb70a76dd64","Type":"ContainerStarted","Data":"a598f496afd4fce9cd5ee05ce50ebb37af72a73fc07215ddf45bdf27c9e8b5c6"} May 26 10:10:59.482669 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.482241 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrzm5" event={"ID":"1a077b07-f576-4f58-b23c-893b3d173175","Type":"ContainerStarted","Data":"80bafded617ef9050f2099121de78d4e78693ab6325c9ad81ba3c5430f507803"} May 26 10:10:59.489584 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.488979 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" event={"ID":"c777765b-fa37-43c3-9b31-225bf12c1e56","Type":"ContainerStarted","Data":"dc1c2920a0cd981f4d697b933b3d47a7f085391283f4142f6a11953c01c9c7fd"} May 26 10:10:59.492392 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.492333 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerStarted","Data":"fcd5c05dfa0bcd1047ab2bb75a40dc1ff337ac3cec932bde3ca4c8cb0aff7e1f"} May 26 10:10:59.497055 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.494932 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" event={"ID":"3f4534f1-7047-4944-b6f6-ecea9352ed74","Type":"ContainerStarted","Data":"315af68fbc16c27dbe77bca318bf03a932249811a57d97928f3987b5fb76ed8e"} May 26 10:10:59.498472 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.498308 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" event={"ID":"d352782c-b47e-4243-87e4-d7112b6c7172","Type":"ContainerStarted","Data":"ba4f2800aef6356bfae09d917f047d932ae984639867f2f2b4fb5f9a3a5b2463"} May 26 10:10:59.510004 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.506180 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" podStartSLOduration=6.909370192 podStartE2EDuration="16.50616151s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.378260006 +0000 UTC m=+44.774369136" lastFinishedPulling="2026-05-26 10:10:58.975051323 +0000 UTC m=+54.371160454" observedRunningTime="2026-05-26 10:10:59.504967938 +0000 UTC m=+54.901077078" watchObservedRunningTime="2026-05-26 10:10:59.50616151 +0000 UTC m=+54.902270648" May 26 10:10:59.510004 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.506286 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-sm4mw" podStartSLOduration=6.8963826489999995 podStartE2EDuration="16.506279177s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.377921336 +0000 UTC m=+44.774030452" lastFinishedPulling="2026-05-26 10:10:58.987817863 +0000 UTC m=+54.383926980" observedRunningTime="2026-05-26 10:10:59.485600435 +0000 UTC m=+54.881709573" watchObservedRunningTime="2026-05-26 10:10:59.506279177 +0000 UTC m=+54.902388316" May 26 10:10:59.532729 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.532664 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n5lkq" podStartSLOduration=13.383159662 podStartE2EDuration="54.532628812s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:10:07.806000298 +0000 UTC m=+3.202109430" lastFinishedPulling="2026-05-26 10:10:48.955469451 +0000 UTC m=+44.351578580" observedRunningTime="2026-05-26 10:10:59.530626848 +0000 UTC m=+54.926735996" watchObservedRunningTime="2026-05-26 10:10:59.532628812 +0000 UTC m=+54.928737950" May 26 10:10:59.552024 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.550214 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wrzm5" podStartSLOduration=38.674221435 podStartE2EDuration="48.550193317s" podCreationTimestamp="2026-05-26 10:10:11 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.377823773 +0000 UTC m=+44.773932889" lastFinishedPulling="2026-05-26 10:10:59.253795642 +0000 UTC m=+54.649904771" observedRunningTime="2026-05-26 10:10:59.549173142 +0000 UTC m=+54.945282292" watchObservedRunningTime="2026-05-26 10:10:59.550193317 +0000 UTC m=+54.946302456" May 26 10:10:59.568784 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.566624 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:10:59.576331 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.572203 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:10:59.576331 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.572312 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.572284094 +0000 UTC m=+70.968393226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:10:59.580179 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.579456 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" podStartSLOduration=7.084679806 podStartE2EDuration="16.579417411s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.482101886 +0000 UTC m=+44.878211001" lastFinishedPulling="2026-05-26 10:10:58.976839491 +0000 UTC m=+54.372948606" observedRunningTime="2026-05-26 10:10:59.576593468 +0000 UTC m=+54.972702587" watchObservedRunningTime="2026-05-26 10:10:59.579417411 +0000 UTC m=+54.975526551" May 26 10:10:59.598808 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.598749 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" podStartSLOduration=7.106075054 podStartE2EDuration="16.598729312s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.482310617 +0000 UTC m=+44.878419734" lastFinishedPulling="2026-05-26 10:10:58.974964878 +0000 UTC m=+54.371073992" observedRunningTime="2026-05-26 10:10:59.597035545 +0000 UTC m=+54.993144682" watchObservedRunningTime="2026-05-26 10:10:59.598729312 +0000 UTC m=+54.994838451" May 26 10:10:59.613657 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.613067 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-h7s5c" podStartSLOduration=7.178131727 podStartE2EDuration="16.613047677s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.482358457 +0000 UTC m=+44.878467580" lastFinishedPulling="2026-05-26 10:10:58.917274405 +0000 UTC m=+54.313383530" observedRunningTime="2026-05-26 10:10:59.612263632 +0000 UTC m=+55.008372769" watchObservedRunningTime="2026-05-26 10:10:59.613047677 +0000 UTC m=+55.009156816" May 26 10:10:59.635830 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.635720 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" podStartSLOduration=7.038791079 podStartE2EDuration="16.635698866s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:10:49.378063388 +0000 UTC m=+44.774172518" lastFinishedPulling="2026-05-26 10:10:58.974971175 +0000 UTC m=+54.371080305" observedRunningTime="2026-05-26 10:10:59.635303523 +0000 UTC m=+55.031412657" watchObservedRunningTime="2026-05-26 10:10:59.635698866 +0000 UTC m=+55.031808003" May 26 10:10:59.678655 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.678447 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:10:59.678835 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:10:59.678683 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:10:59.678893 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.678864 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found May 26 10:10:59.678947 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.678933 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found May 26 10:10:59.678999 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.678961 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls podName:dc7049ba-f170-4304-887a-66edfeb9b779 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.678938669 +0000 UTC m=+71.075047803 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-lkfrv" (UID: "dc7049ba-f170-4304-887a-66edfeb9b779") : secret "cluster-monitoring-operator-tls" not found May 26 10:10:59.678999 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:10:59.678981 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls podName:c24acf33-10e5-4658-9071-5d179dd36d3e nodeName:}" failed. No retries permitted until 2026-05-26 10:11:15.678969318 +0000 UTC m=+71.075078447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls") pod "cluster-samples-operator-697587599-tknw5" (UID: "c24acf33-10e5-4658-9071-5d179dd36d3e") : secret "samples-operator-tls" not found May 26 10:11:00.504617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.504577 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerStarted","Data":"52ca5d0ebdae2564dd62dd3ceee60ed45bafff9a17a22363845f248f7bf3a5c4"} May 26 10:11:00.506139 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.506117 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/0.log" May 26 10:11:00.506257 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.506164 2559 generic.go:358] "Generic (PLEG): container finished" podID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" containerID="2a588dda9824a5fd11aa8834f283d99b0d1eeebbcd3e61a0ffe766614676784d" exitCode=255 May 26 10:11:00.506326 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.506285 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" event={"ID":"69c25770-d860-4c8c-8965-ab8bf02cd2b6","Type":"ContainerDied","Data":"2a588dda9824a5fd11aa8834f283d99b0d1eeebbcd3e61a0ffe766614676784d"} May 26 10:11:00.506477 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.506462 2559 scope.go:117] "RemoveContainer" containerID="2a588dda9824a5fd11aa8834f283d99b0d1eeebbcd3e61a0ffe766614676784d" May 26 10:11:00.560668 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:00.560597 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" podStartSLOduration=31.115905833 podStartE2EDuration="50.560576731s" podCreationTimestamp="2026-05-26 10:10:10 +0000 UTC" firstStartedPulling="2026-05-26 10:10:39.531727332 +0000 UTC m=+34.927836447" lastFinishedPulling="2026-05-26 10:10:58.976398228 +0000 UTC m=+54.372507345" observedRunningTime="2026-05-26 10:11:00.531901975 +0000 UTC m=+55.928011113" watchObservedRunningTime="2026-05-26 10:11:00.560576731 +0000 UTC m=+55.956685869" May 26 10:11:01.512775 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.512744 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:11:01.513182 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.513110 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/0.log" May 26 10:11:01.513182 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.513143 2559 generic.go:358] "Generic (PLEG): container finished" podID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" exitCode=255 May 26 10:11:01.513291 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.513233 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" event={"ID":"69c25770-d860-4c8c-8965-ab8bf02cd2b6","Type":"ContainerDied","Data":"a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025"} May 26 10:11:01.513291 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.513277 2559 scope.go:117] "RemoveContainer" containerID="2a588dda9824a5fd11aa8834f283d99b0d1eeebbcd3e61a0ffe766614676784d" May 26 10:11:01.513533 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:01.513505 2559 scope.go:117] "RemoveContainer" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" May 26 10:11:01.513735 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:01.513716 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pwk6b_openshift-console-operator(69c25770-d860-4c8c-8965-ab8bf02cd2b6)\"" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" podUID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" May 26 10:11:02.287219 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:02.287191 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8wrj_3b5a6113-a99d-4f42-91b0-afac5f987e52/dns-node-resolver/0.log" May 26 10:11:02.517160 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:02.517132 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:11:02.517569 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:02.517486 2559 scope.go:117] "RemoveContainer" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" May 26 10:11:02.517698 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:02.517679 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pwk6b_openshift-console-operator(69c25770-d860-4c8c-8965-ab8bf02cd2b6)\"" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" podUID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" May 26 10:11:03.324558 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:03.324528 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h9rf2" May 26 10:11:03.486446 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:03.486421 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ct4xd_aa0484c9-1cdb-4bab-8408-1804b7965bb1/node-ca/0.log" May 26 10:11:03.932745 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:03.932699 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:11:03.933231 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:03.933174 2559 scope.go:117] "RemoveContainer" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" May 26 10:11:03.933389 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:03.933369 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pwk6b_openshift-console-operator(69c25770-d860-4c8c-8965-ab8bf02cd2b6)\"" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" podUID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" May 26 10:11:09.478207 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:09.478161 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:11:09.478804 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:09.478689 2559 scope.go:117] "RemoveContainer" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" May 26 10:11:09.478948 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:09.478926 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-pwk6b_openshift-console-operator(69c25770-d860-4c8c-8965-ab8bf02cd2b6)\"" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" podUID="69c25770-d860-4c8c-8965-ab8bf02cd2b6" May 26 10:11:10.879666 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.879612 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:11:10.881788 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.881763 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 26 10:11:10.890352 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:10.890332 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 26 10:11:10.890489 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:10.890414 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs podName:911fd9ce-a15b-4db5-b7a1-200ce0e77759 nodeName:}" failed. No retries permitted until 2026-05-26 10:12:14.890390883 +0000 UTC m=+130.286499999 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs") pod "network-metrics-daemon-4rt42" (UID: "911fd9ce-a15b-4db5-b7a1-200ce0e77759") : secret "metrics-daemon-secret" not found May 26 10:11:10.980289 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.980251 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:11:10.980494 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.980345 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:11:10.980494 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.980374 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:11:10.980494 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:10.980419 2559 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 26 10:11:10.980694 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:10.980503 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert podName:7acae325-51d9-4f45-8669-46262f25ccee nodeName:}" failed. No retries permitted until 2026-05-26 10:11:42.980483537 +0000 UTC m=+98.376592656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert") pod "ingress-canary-gvs8f" (UID: "7acae325-51d9-4f45-8669-46262f25ccee") : secret "canary-serving-cert" not found May 26 10:11:10.982843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.982818 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d9ffbe-34f5-49be-bf7c-3919d8e6bc26-metrics-tls\") pod \"dns-default-fbg7z\" (UID: \"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26\") " pod="openshift-dns/dns-default-fbg7z" May 26 10:11:10.983101 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:10.983081 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmst\" (UniqueName: \"kubernetes.io/projected/462c82f9-6340-4f2c-85dc-529b604247c8-kube-api-access-ftmst\") pod \"network-check-target-rr5mj\" (UID: \"462c82f9-6340-4f2c-85dc-529b604247c8\") " pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:11:11.022085 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.022054 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sn4kp\"" May 26 10:11:11.030801 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.030775 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:11:11.081347 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.081313 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:11:11.083922 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.083902 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"image-registry-6856f957f-qknnb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:11:11.152317 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.152245 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rr5mj"] May 26 10:11:11.153351 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.153331 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mm9pv\"" May 26 10:11:11.156718 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:11.156686 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462c82f9_6340_4f2c_85dc_529b604247c8.slice/crio-bf88981194fc9aaab997bcef6bd7cd17b7ff87bd748bb336b782fd6a79c655c8 WatchSource:0}: Error finding container bf88981194fc9aaab997bcef6bd7cd17b7ff87bd748bb336b782fd6a79c655c8: Status 404 returned error can't find the container with id bf88981194fc9aaab997bcef6bd7cd17b7ff87bd748bb336b782fd6a79c655c8 May 26 10:11:11.161862 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.161845 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fbg7z" May 26 10:11:11.164971 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.164953 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-smbnk\"" May 26 10:11:11.174501 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.174472 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:11:11.316878 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.316824 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fbg7z"] May 26 10:11:11.320911 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:11.320876 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d9ffbe_34f5_49be_bf7c_3919d8e6bc26.slice/crio-ce879eabeda2e8412b59ab65fe8dc9b00889252a4d686f7d08a1586e70db94f9 WatchSource:0}: Error finding container ce879eabeda2e8412b59ab65fe8dc9b00889252a4d686f7d08a1586e70db94f9: Status 404 returned error can't find the container with id ce879eabeda2e8412b59ab65fe8dc9b00889252a4d686f7d08a1586e70db94f9 May 26 10:11:11.346558 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.346529 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:11:11.349938 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:11.349902 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a6ca47b_b6d0_4785_876e_0f20565b6abb.slice/crio-918f04aa7ed8c6d23a74cbd53df0d137abea3af68136561c2ca431426d5cb578 WatchSource:0}: Error finding container 918f04aa7ed8c6d23a74cbd53df0d137abea3af68136561c2ca431426d5cb578: Status 404 returned error can't find the container with id 918f04aa7ed8c6d23a74cbd53df0d137abea3af68136561c2ca431426d5cb578 May 26 10:11:11.544126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.544087 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rr5mj" event={"ID":"462c82f9-6340-4f2c-85dc-529b604247c8","Type":"ContainerStarted","Data":"ea7d0d93c6d247d7d92738d209ec7c4130aac5a06a1909a1fc4cf7286116736e"} May 26 10:11:11.544126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.544129 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rr5mj" event={"ID":"462c82f9-6340-4f2c-85dc-529b604247c8","Type":"ContainerStarted","Data":"bf88981194fc9aaab997bcef6bd7cd17b7ff87bd748bb336b782fd6a79c655c8"} May 26 10:11:11.544356 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.544173 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:11:11.545486 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.545462 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6856f957f-qknnb" event={"ID":"9a6ca47b-b6d0-4785-876e-0f20565b6abb","Type":"ContainerStarted","Data":"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de"} May 26 10:11:11.545599 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.545489 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6856f957f-qknnb" event={"ID":"9a6ca47b-b6d0-4785-876e-0f20565b6abb","Type":"ContainerStarted","Data":"918f04aa7ed8c6d23a74cbd53df0d137abea3af68136561c2ca431426d5cb578"} May 26 10:11:11.545678 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.545598 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:11:11.546419 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.546391 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fbg7z" event={"ID":"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26","Type":"ContainerStarted","Data":"ce879eabeda2e8412b59ab65fe8dc9b00889252a4d686f7d08a1586e70db94f9"} May 26 10:11:11.558190 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.558143 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rr5mj" podStartSLOduration=66.558129979 podStartE2EDuration="1m6.558129979s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:11:11.558043851 +0000 UTC m=+66.954153005" watchObservedRunningTime="2026-05-26 10:11:11.558129979 +0000 UTC m=+66.954239116" May 26 10:11:11.576211 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:11.576164 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6856f957f-qknnb" podStartSLOduration=66.576150412 podStartE2EDuration="1m6.576150412s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:11:11.575369881 +0000 UTC m=+66.971479018" watchObservedRunningTime="2026-05-26 10:11:11.576150412 +0000 UTC m=+66.972259575" May 26 10:11:13.557467 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:13.557427 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fbg7z" event={"ID":"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26","Type":"ContainerStarted","Data":"15b874762cb5e90834c0585062ca5e2a5bf32bbdd9db5d7a1bc368afea6d737c"} May 26 10:11:13.557467 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:13.557474 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fbg7z" event={"ID":"60d9ffbe-34f5-49be-bf7c-3919d8e6bc26","Type":"ContainerStarted","Data":"4c64c8cc2689fd46824de48defae610c93e9d6326abdfbb3e25378be5e721a70"} May 26 10:11:13.557940 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:13.557539 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fbg7z" May 26 10:11:13.573867 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:13.573820 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fbg7z" podStartSLOduration=33.91956099 podStartE2EDuration="35.573805023s" podCreationTimestamp="2026-05-26 10:10:38 +0000 UTC" firstStartedPulling="2026-05-26 10:11:11.322884503 +0000 UTC m=+66.718993619" lastFinishedPulling="2026-05-26 10:11:12.977128533 +0000 UTC m=+68.373237652" observedRunningTime="2026-05-26 10:11:13.573115314 +0000 UTC m=+68.969224451" watchObservedRunningTime="2026-05-26 10:11:13.573805023 +0000 UTC m=+68.969914159" May 26 10:11:15.517661 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.517487 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:15.517661 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.517615 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:15.518169 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.518025 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f4289b5-0a91-47bf-94a9-596d42576100-service-ca-bundle\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:15.520196 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.520173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f4289b5-0a91-47bf-94a9-596d42576100-metrics-certs\") pod \"router-default-575fd68fbd-x59tq\" (UID: \"0f4289b5-0a91-47bf-94a9-596d42576100\") " pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:15.618280 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.618233 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:11:15.618432 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:15.618381 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found May 26 10:11:15.618495 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:11:15.618461 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert podName:33dea431-277f-44e6-8ee4-bbd8f389ebf3 nodeName:}" failed. No retries permitted until 2026-05-26 10:11:47.618444676 +0000 UTC m=+103.014553792 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-gf9wm" (UID: "33dea431-277f-44e6-8ee4-bbd8f389ebf3") : secret "networking-console-plugin-cert" not found May 26 10:11:15.718917 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.718872 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:11:15.718917 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.718921 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:11:15.721516 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.721489 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c24acf33-10e5-4658-9071-5d179dd36d3e-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tknw5\" (UID: \"c24acf33-10e5-4658-9071-5d179dd36d3e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:11:15.721620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.721599 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/dc7049ba-f170-4304-887a-66edfeb9b779-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-lkfrv\" (UID: \"dc7049ba-f170-4304-887a-66edfeb9b779\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:11:15.741348 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.741322 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zz949\"" May 26 10:11:15.750365 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.750335 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:15.881290 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.881256 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-575fd68fbd-x59tq"] May 26 10:11:15.884359 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:15.884332 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f4289b5_0a91_47bf_94a9_596d42576100.slice/crio-26eca3c877e9ef1aa02387adca50c1a99331727804e46030c54be424a4b9ce6a WatchSource:0}: Error finding container 26eca3c877e9ef1aa02387adca50c1a99331727804e46030c54be424a4b9ce6a: Status 404 returned error can't find the container with id 26eca3c877e9ef1aa02387adca50c1a99331727804e46030c54be424a4b9ce6a May 26 10:11:15.962325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.962293 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjqbj\"" May 26 10:11:15.971062 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:15.971036 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" May 26 10:11:16.015854 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.015827 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wgxc7\"" May 26 10:11:16.024206 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.024084 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" May 26 10:11:16.105298 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.105261 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5"] May 26 10:11:16.159323 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.159297 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv"] May 26 10:11:16.162010 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:16.161981 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7049ba_f170_4304_887a_66edfeb9b779.slice/crio-f1c170245bf784265a04603037b6894bd4b24f8451db939c944a05efbe43057d WatchSource:0}: Error finding container f1c170245bf784265a04603037b6894bd4b24f8451db939c944a05efbe43057d: Status 404 returned error can't find the container with id f1c170245bf784265a04603037b6894bd4b24f8451db939c944a05efbe43057d May 26 10:11:16.567505 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.567462 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" event={"ID":"dc7049ba-f170-4304-887a-66edfeb9b779","Type":"ContainerStarted","Data":"f1c170245bf784265a04603037b6894bd4b24f8451db939c944a05efbe43057d"} May 26 10:11:16.568516 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.568486 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" event={"ID":"c24acf33-10e5-4658-9071-5d179dd36d3e","Type":"ContainerStarted","Data":"7baf49b401c071087459f0c2d28a1ec4c5d631f35f9aa9cb990f40a0fb7dd879"} May 26 10:11:16.569616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.569594 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-575fd68fbd-x59tq" event={"ID":"0f4289b5-0a91-47bf-94a9-596d42576100","Type":"ContainerStarted","Data":"48569ce85dd18dc8d29407ab94de770609e77aa922337773576af591d82cb808"} May 26 10:11:16.569708 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.569621 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-575fd68fbd-x59tq" event={"ID":"0f4289b5-0a91-47bf-94a9-596d42576100","Type":"ContainerStarted","Data":"26eca3c877e9ef1aa02387adca50c1a99331727804e46030c54be424a4b9ce6a"} May 26 10:11:16.588301 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.588254 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-575fd68fbd-x59tq" podStartSLOduration=33.588238111 podStartE2EDuration="33.588238111s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:11:16.587378032 +0000 UTC m=+71.983487163" watchObservedRunningTime="2026-05-26 10:11:16.588238111 +0000 UTC m=+71.984347248" May 26 10:11:16.750730 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.750623 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:16.753235 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:16.753212 2559 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:17.576928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:17.576899 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:17.578347 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:17.578321 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-575fd68fbd-x59tq" May 26 10:11:19.585063 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:19.585030 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" event={"ID":"dc7049ba-f170-4304-887a-66edfeb9b779","Type":"ContainerStarted","Data":"0445ca9f3508cd2b0b0a646977b314c9431955caf3c50d303e62c55eb1cb540c"} May 26 10:11:19.587177 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:19.587147 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" event={"ID":"c24acf33-10e5-4658-9071-5d179dd36d3e","Type":"ContainerStarted","Data":"eb8b818be4b746dcd73b9f0341c07498694bd94308b8e7ec15c13ca957321598"} May 26 10:11:19.604928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:19.604794 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-lkfrv" podStartSLOduration=33.396091757 podStartE2EDuration="36.604776853s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.163768714 +0000 UTC m=+71.559877829" lastFinishedPulling="2026-05-26 10:11:19.37245381 +0000 UTC m=+74.768562925" observedRunningTime="2026-05-26 10:11:19.604537055 +0000 UTC m=+75.000646196" watchObservedRunningTime="2026-05-26 10:11:19.604776853 +0000 UTC m=+75.000885990" May 26 10:11:20.591349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:20.591317 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" event={"ID":"c24acf33-10e5-4658-9071-5d179dd36d3e","Type":"ContainerStarted","Data":"d68ef94b249ad61566ffc1d05834e474c90563b41fe7cfda5239c706fc3175a3"} May 26 10:11:20.607548 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:20.607505 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tknw5" podStartSLOduration=34.399755531 podStartE2EDuration="37.607491703s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:11:16.161022689 +0000 UTC m=+71.557131818" lastFinishedPulling="2026-05-26 10:11:19.368758872 +0000 UTC m=+74.764867990" observedRunningTime="2026-05-26 10:11:20.607212186 +0000 UTC m=+76.003321324" watchObservedRunningTime="2026-05-26 10:11:20.607491703 +0000 UTC m=+76.003600840" May 26 10:11:22.199378 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:22.199343 2559 scope.go:117] "RemoveContainer" containerID="a9cae072db5509991d17fdd38bc652ecab692f05e1b032808f0983231a2da025" May 26 10:11:22.598704 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:22.598679 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:11:22.598869 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:22.598735 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" event={"ID":"69c25770-d860-4c8c-8965-ab8bf02cd2b6","Type":"ContainerStarted","Data":"1236c866f6036b05c3d8abc1e5a43b70d3d97b21717102f1a73fc44c3b33710a"} May 26 10:11:22.599033 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:22.599015 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:11:22.873427 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:22.873357 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-pwk6b" May 26 10:11:23.562146 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:23.562114 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fbg7z" May 26 10:11:24.078657 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.078610 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdj8"] May 26 10:11:24.099315 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.099290 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.102082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.102059 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x2tcm\"" May 26 10:11:24.102887 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.102863 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 26 10:11:24.103025 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.102875 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 26 10:11:24.108170 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.108147 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdj8"] May 26 10:11:24.196481 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.196451 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec56f004-0515-4171-a6d0-dbd002755810-data-volume\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.196649 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.196485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhvl\" (UniqueName: \"kubernetes.io/projected/ec56f004-0515-4171-a6d0-dbd002755810-kube-api-access-ddhvl\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.196649 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.196522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec56f004-0515-4171-a6d0-dbd002755810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.196649 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.196588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec56f004-0515-4171-a6d0-dbd002755810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.196649 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.196648 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec56f004-0515-4171-a6d0-dbd002755810-crio-socket\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297180 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297140 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec56f004-0515-4171-a6d0-dbd002755810-data-volume\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297180 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297183 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhvl\" (UniqueName: \"kubernetes.io/projected/ec56f004-0515-4171-a6d0-dbd002755810-kube-api-access-ddhvl\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297420 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297232 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec56f004-0515-4171-a6d0-dbd002755810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297420 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297301 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec56f004-0515-4171-a6d0-dbd002755810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297420 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297375 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec56f004-0515-4171-a6d0-dbd002755810-crio-socket\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297566 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297477 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ec56f004-0515-4171-a6d0-dbd002755810-crio-socket\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297566 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297488 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ec56f004-0515-4171-a6d0-dbd002755810-data-volume\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.297891 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.297868 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ec56f004-0515-4171-a6d0-dbd002755810-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.299954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.299930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ec56f004-0515-4171-a6d0-dbd002755810-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.304958 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.304938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhvl\" (UniqueName: \"kubernetes.io/projected/ec56f004-0515-4171-a6d0-dbd002755810-kube-api-access-ddhvl\") pod \"insights-runtime-extractor-7vdj8\" (UID: \"ec56f004-0515-4171-a6d0-dbd002755810\") " pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.410277 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.410180 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7vdj8" May 26 10:11:24.541329 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.541302 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7vdj8"] May 26 10:11:24.543738 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:24.543709 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec56f004_0515_4171_a6d0_dbd002755810.slice/crio-0629712c828a8a3ba7a789caa7cbd64dc548bab03025033bbb8b6785db4fd4b5 WatchSource:0}: Error finding container 0629712c828a8a3ba7a789caa7cbd64dc548bab03025033bbb8b6785db4fd4b5: Status 404 returned error can't find the container with id 0629712c828a8a3ba7a789caa7cbd64dc548bab03025033bbb8b6785db4fd4b5 May 26 10:11:24.604065 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:24.604035 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdj8" event={"ID":"ec56f004-0515-4171-a6d0-dbd002755810","Type":"ContainerStarted","Data":"0629712c828a8a3ba7a789caa7cbd64dc548bab03025033bbb8b6785db4fd4b5"} May 26 10:11:25.607350 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:25.607313 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdj8" event={"ID":"ec56f004-0515-4171-a6d0-dbd002755810","Type":"ContainerStarted","Data":"fcf06f5721609dea5493156be5616fa67601af953c4bf540c6eb9f3c293af073"} May 26 10:11:26.615765 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:26.615727 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdj8" event={"ID":"ec56f004-0515-4171-a6d0-dbd002755810","Type":"ContainerStarted","Data":"6a831dd78a497d2770874e412139cee1cf0e58787c5e323e73b0ba2a7bb91a5f"} May 26 10:11:27.620185 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:27.620147 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7vdj8" event={"ID":"ec56f004-0515-4171-a6d0-dbd002755810","Type":"ContainerStarted","Data":"3ba8f2f8da2b5346a1931c3d1f9119427ce14e61a8853dd15ab35656ba26ad3a"} May 26 10:11:28.640553 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:28.640503 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7vdj8" podStartSLOduration=1.83003997 podStartE2EDuration="4.6404899s" podCreationTimestamp="2026-05-26 10:11:24 +0000 UTC" firstStartedPulling="2026-05-26 10:11:24.675978555 +0000 UTC m=+80.072087683" lastFinishedPulling="2026-05-26 10:11:27.486428498 +0000 UTC m=+82.882537613" observedRunningTime="2026-05-26 10:11:28.639546462 +0000 UTC m=+84.035655608" watchObservedRunningTime="2026-05-26 10:11:28.6404899 +0000 UTC m=+84.036599036" May 26 10:11:31.179304 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:31.179269 2559 patch_prober.go:28] interesting pod/image-registry-6856f957f-qknnb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 26 10:11:31.179707 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:31.179321 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6856f957f-qknnb" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 10:11:32.559150 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:32.559123 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:11:35.456863 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.456825 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sdznf"] May 26 10:11:35.493260 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.493222 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.496047 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.496014 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-p5hdm\"" May 26 10:11:35.496185 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.496167 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 26 10:11:35.496287 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.496269 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 26 10:11:35.496364 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.496278 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 26 10:11:35.496620 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.496604 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 26 10:11:35.592472 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdtqg\" (UniqueName: \"kubernetes.io/projected/ebd106be-d2e3-4ee8-971a-159707da61ea-kube-api-access-hdtqg\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592650 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592650 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592517 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-textfile\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592650 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592588 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-tls\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592788 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-wtmp\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592788 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592707 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-root\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592788 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-sys\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.592883 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.592831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-metrics-client-ca\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693833 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693795 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-wtmp\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693852 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-root\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693895 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-root\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693948 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-sys\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693966 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-metrics-client-ca\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.693989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693975 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-wtmp\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.693995 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdtqg\" (UniqueName: \"kubernetes.io/projected/ebd106be-d2e3-4ee8-971a-159707da61ea-kube-api-access-hdtqg\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694039 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ebd106be-d2e3-4ee8-971a-159707da61ea-sys\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694077 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694116 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-textfile\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-tls\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694528 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694508 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-textfile\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694624 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-metrics-client-ca\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.694758 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.694684 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.696490 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.696473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-tls\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.696592 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.696550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ebd106be-d2e3-4ee8-971a-159707da61ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.701558 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.701536 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdtqg\" (UniqueName: \"kubernetes.io/projected/ebd106be-d2e3-4ee8-971a-159707da61ea-kube-api-access-hdtqg\") pod \"node-exporter-sdznf\" (UID: \"ebd106be-d2e3-4ee8-971a-159707da61ea\") " pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.803273 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:35.803234 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sdznf" May 26 10:11:35.812262 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:35.812231 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd106be_d2e3_4ee8_971a_159707da61ea.slice/crio-a531f4446cdb23688825fcabef12895927f38f0cd76df85aea4fe84f81da8a6e WatchSource:0}: Error finding container a531f4446cdb23688825fcabef12895927f38f0cd76df85aea4fe84f81da8a6e: Status 404 returned error can't find the container with id a531f4446cdb23688825fcabef12895927f38f0cd76df85aea4fe84f81da8a6e May 26 10:11:36.652064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:36.652018 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdznf" event={"ID":"ebd106be-d2e3-4ee8-971a-159707da61ea","Type":"ContainerStarted","Data":"a531f4446cdb23688825fcabef12895927f38f0cd76df85aea4fe84f81da8a6e"} May 26 10:11:37.656738 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:37.656704 2559 generic.go:358] "Generic (PLEG): container finished" podID="ebd106be-d2e3-4ee8-971a-159707da61ea" containerID="ee26086bd834281105a3b884a4626ee8feaab5cf57b6a6f8a47b319d6e30838b" exitCode=0 May 26 10:11:37.657211 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:37.656781 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdznf" event={"ID":"ebd106be-d2e3-4ee8-971a-159707da61ea","Type":"ContainerDied","Data":"ee26086bd834281105a3b884a4626ee8feaab5cf57b6a6f8a47b319d6e30838b"} May 26 10:11:38.661305 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:38.661268 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdznf" event={"ID":"ebd106be-d2e3-4ee8-971a-159707da61ea","Type":"ContainerStarted","Data":"d79dbfa92bad3832a3a7140940a548ddc87fd370ea9425dd2061c215a3ff67bc"} May 26 10:11:38.661716 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:38.661311 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sdznf" event={"ID":"ebd106be-d2e3-4ee8-971a-159707da61ea","Type":"ContainerStarted","Data":"f818a6fae92c4d86579a461a34ab6bf51fc3dda570461a05a14a2e4c85114392"} May 26 10:11:38.679714 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:38.679664 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sdznf" podStartSLOduration=2.734954547 podStartE2EDuration="3.679629441s" podCreationTimestamp="2026-05-26 10:11:35 +0000 UTC" firstStartedPulling="2026-05-26 10:11:35.81395317 +0000 UTC m=+91.210062286" lastFinishedPulling="2026-05-26 10:11:36.75862805 +0000 UTC m=+92.154737180" observedRunningTime="2026-05-26 10:11:38.678260053 +0000 UTC m=+94.074369190" watchObservedRunningTime="2026-05-26 10:11:38.679629441 +0000 UTC m=+94.075738577" May 26 10:11:42.557571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:42.557532 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rr5mj" May 26 10:11:43.061280 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.061244 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:11:43.063801 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.063770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7acae325-51d9-4f45-8669-46262f25ccee-cert\") pod \"ingress-canary-gvs8f\" (UID: \"7acae325-51d9-4f45-8669-46262f25ccee\") " pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:11:43.223721 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.223692 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lb2l8\"" May 26 10:11:43.232213 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.232193 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gvs8f" May 26 10:11:43.359704 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.359667 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gvs8f"] May 26 10:11:43.363428 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:43.363393 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acae325_51d9_4f45_8669_46262f25ccee.slice/crio-1b0772f408a538d2ffc4dd755d87723eaa64a0b3d4ecdf2ea987356f46922123 WatchSource:0}: Error finding container 1b0772f408a538d2ffc4dd755d87723eaa64a0b3d4ecdf2ea987356f46922123: Status 404 returned error can't find the container with id 1b0772f408a538d2ffc4dd755d87723eaa64a0b3d4ecdf2ea987356f46922123 May 26 10:11:43.674970 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:43.674887 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gvs8f" event={"ID":"7acae325-51d9-4f45-8669-46262f25ccee","Type":"ContainerStarted","Data":"1b0772f408a538d2ffc4dd755d87723eaa64a0b3d4ecdf2ea987356f46922123"} May 26 10:11:45.682234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:45.682191 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gvs8f" event={"ID":"7acae325-51d9-4f45-8669-46262f25ccee","Type":"ContainerStarted","Data":"79d341a030066b93ab2638b32af72d596da16675ada56fcfab23c39bb735f519"} May 26 10:11:45.697774 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:45.697710 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gvs8f" podStartSLOduration=65.561860642 podStartE2EDuration="1m7.69769363s" podCreationTimestamp="2026-05-26 10:10:38 +0000 UTC" firstStartedPulling="2026-05-26 10:11:43.365297171 +0000 UTC m=+98.761406292" lastFinishedPulling="2026-05-26 10:11:45.501130166 +0000 UTC m=+100.897239280" observedRunningTime="2026-05-26 10:11:45.696997638 +0000 UTC m=+101.093106776" watchObservedRunningTime="2026-05-26 10:11:45.69769363 +0000 UTC m=+101.093802767" May 26 10:11:46.969781 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:46.969737 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:11:47.702372 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:47.702336 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:11:47.704873 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:47.704841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/33dea431-277f-44e6-8ee4-bbd8f389ebf3-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-gf9wm\" (UID: \"33dea431-277f-44e6-8ee4-bbd8f389ebf3\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:11:47.907301 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:47.907266 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjl85\"" May 26 10:11:47.915931 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:47.915910 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" May 26 10:11:48.075250 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:48.075212 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm"] May 26 10:11:48.078252 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:11:48.078221 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33dea431_277f_44e6_8ee4_bbd8f389ebf3.slice/crio-0f8308188fd7137c03ff3ed35c17c5d3aeb9174cd79d9f4f45414ae0c71bd7a3 WatchSource:0}: Error finding container 0f8308188fd7137c03ff3ed35c17c5d3aeb9174cd79d9f4f45414ae0c71bd7a3: Status 404 returned error can't find the container with id 0f8308188fd7137c03ff3ed35c17c5d3aeb9174cd79d9f4f45414ae0c71bd7a3 May 26 10:11:48.692200 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:48.692139 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" event={"ID":"33dea431-277f-44e6-8ee4-bbd8f389ebf3","Type":"ContainerStarted","Data":"0f8308188fd7137c03ff3ed35c17c5d3aeb9174cd79d9f4f45414ae0c71bd7a3"} May 26 10:11:50.700163 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:50.700106 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" event={"ID":"33dea431-277f-44e6-8ee4-bbd8f389ebf3","Type":"ContainerStarted","Data":"2013cf9e2ffcdda8348706e6686aa2fb27d7d12e22a67e7c18ef267a6d2337fd"} May 26 10:11:50.722573 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:11:50.722509 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-gf9wm" podStartSLOduration=66.069617863 podStartE2EDuration="1m7.722490095s" podCreationTimestamp="2026-05-26 10:10:43 +0000 UTC" firstStartedPulling="2026-05-26 10:11:48.080563112 +0000 UTC m=+103.476672226" lastFinishedPulling="2026-05-26 10:11:49.733435324 +0000 UTC m=+105.129544458" observedRunningTime="2026-05-26 10:11:50.721683377 +0000 UTC m=+106.117792513" watchObservedRunningTime="2026-05-26 10:11:50.722490095 +0000 UTC m=+106.118599233" May 26 10:12:10.757921 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.757886 2559 generic.go:358] "Generic (PLEG): container finished" podID="c777765b-fa37-43c3-9b31-225bf12c1e56" containerID="dc1c2920a0cd981f4d697b933b3d47a7f085391283f4142f6a11953c01c9c7fd" exitCode=0 May 26 10:12:10.758370 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.757960 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" event={"ID":"c777765b-fa37-43c3-9b31-225bf12c1e56","Type":"ContainerDied","Data":"dc1c2920a0cd981f4d697b933b3d47a7f085391283f4142f6a11953c01c9c7fd"} May 26 10:12:10.758370 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.758306 2559 scope.go:117] "RemoveContainer" containerID="dc1c2920a0cd981f4d697b933b3d47a7f085391283f4142f6a11953c01c9c7fd" May 26 10:12:10.759384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.759360 2559 generic.go:358] "Generic (PLEG): container finished" podID="2a1fd620-8f7d-4adf-82da-7cb70a76dd64" containerID="a598f496afd4fce9cd5ee05ce50ebb37af72a73fc07215ddf45bdf27c9e8b5c6" exitCode=0 May 26 10:12:10.759478 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.759435 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" event={"ID":"2a1fd620-8f7d-4adf-82da-7cb70a76dd64","Type":"ContainerDied","Data":"a598f496afd4fce9cd5ee05ce50ebb37af72a73fc07215ddf45bdf27c9e8b5c6"} May 26 10:12:10.759767 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:10.759756 2559 scope.go:117] "RemoveContainer" containerID="a598f496afd4fce9cd5ee05ce50ebb37af72a73fc07215ddf45bdf27c9e8b5c6" May 26 10:12:11.763895 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:11.763855 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-wxcx9" event={"ID":"2a1fd620-8f7d-4adf-82da-7cb70a76dd64","Type":"ContainerStarted","Data":"20b33d4bc3d7c62728f4c1ba9e69f3ef57b36a3ca03072bb6c791c95762cf3d4"} May 26 10:12:11.765453 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:11.765430 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-c6zlk" event={"ID":"c777765b-fa37-43c3-9b31-225bf12c1e56","Type":"ContainerStarted","Data":"570fe8cbdae34d574287bb79a83e49f98029201f8013ef2ed2ea0f6cfad62d63"} May 26 10:12:11.989812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:11.989773 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6856f957f-qknnb" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerName="registry" containerID="cri-o://5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de" gracePeriod=30 May 26 10:12:12.235064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.235037 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:12:12.346047 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346010 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346061 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ms7t\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346100 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346121 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346146 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346165 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346216 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346196 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346518 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346235 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates\") pod \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\" (UID: \"9a6ca47b-b6d0-4785-876e-0f20565b6abb\") " May 26 10:12:12.346518 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346502 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:12:12.346889 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.346848 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 26 10:12:12.348786 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.348739 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:12:12.349041 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.349014 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:12:12.349119 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.349055 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t" (OuterVolumeSpecName: "kube-api-access-5ms7t") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "kube-api-access-5ms7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:12:12.349119 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.349099 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 26 10:12:12.349236 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.349127 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:12:12.354987 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.354956 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9a6ca47b-b6d0-4785-876e-0f20565b6abb" (UID: "9a6ca47b-b6d0-4785-876e-0f20565b6abb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 10:12:12.447052 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.446969 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-certificates\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447052 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447006 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9a6ca47b-b6d0-4785-876e-0f20565b6abb-trusted-ca\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447052 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447023 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ms7t\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-kube-api-access-5ms7t\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447052 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447038 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9a6ca47b-b6d0-4785-876e-0f20565b6abb-ca-trust-extracted\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447052 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447054 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-installation-pull-secrets\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447308 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447068 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9a6ca47b-b6d0-4785-876e-0f20565b6abb-image-registry-private-configuration\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447308 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447085 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-registry-tls\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.447308 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.447099 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9a6ca47b-b6d0-4785-876e-0f20565b6abb-bound-sa-token\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:12:12.769532 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.769498 2559 generic.go:358] "Generic (PLEG): container finished" podID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerID="5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de" exitCode=0 May 26 10:12:12.769928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.769560 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6856f957f-qknnb" May 26 10:12:12.769928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.769584 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6856f957f-qknnb" event={"ID":"9a6ca47b-b6d0-4785-876e-0f20565b6abb","Type":"ContainerDied","Data":"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de"} May 26 10:12:12.769928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.769618 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6856f957f-qknnb" event={"ID":"9a6ca47b-b6d0-4785-876e-0f20565b6abb","Type":"ContainerDied","Data":"918f04aa7ed8c6d23a74cbd53df0d137abea3af68136561c2ca431426d5cb578"} May 26 10:12:12.769928 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.769651 2559 scope.go:117] "RemoveContainer" containerID="5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de" May 26 10:12:12.778611 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.778594 2559 scope.go:117] "RemoveContainer" containerID="5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de" May 26 10:12:12.778894 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:12:12.778873 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de\": container with ID starting with 5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de not found: ID does not exist" containerID="5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de" May 26 10:12:12.778942 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.778902 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de"} err="failed to get container status \"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de\": rpc error: code = NotFound desc = could not find container \"5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de\": container with ID starting with 5dd56dd81c6c59186d99a6172942393eaec90ac2ed8120bb3e653251292be9de not found: ID does not exist" May 26 10:12:12.789761 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.789738 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:12:12.793157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:12.793138 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6856f957f-qknnb"] May 26 10:12:13.203285 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:13.203211 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" path="/var/lib/kubelet/pods/9a6ca47b-b6d0-4785-876e-0f20565b6abb/volumes" May 26 10:12:14.967743 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:14.967697 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:12:14.970247 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:14.970218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/911fd9ce-a15b-4db5-b7a1-200ce0e77759-metrics-certs\") pod \"network-metrics-daemon-4rt42\" (UID: \"911fd9ce-a15b-4db5-b7a1-200ce0e77759\") " pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:12:15.211812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:15.211781 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dpb8v\"" May 26 10:12:15.220734 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:15.220671 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4rt42" May 26 10:12:15.349113 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:15.349077 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4rt42"] May 26 10:12:15.352133 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:12:15.352100 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911fd9ce_a15b_4db5_b7a1_200ce0e77759.slice/crio-dd2954958f45cf82a72dfa70a89678e9fb49948b4dcbe143d49a6f19ce38623d WatchSource:0}: Error finding container dd2954958f45cf82a72dfa70a89678e9fb49948b4dcbe143d49a6f19ce38623d: Status 404 returned error can't find the container with id dd2954958f45cf82a72dfa70a89678e9fb49948b4dcbe143d49a6f19ce38623d May 26 10:12:15.780800 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:15.780763 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rt42" event={"ID":"911fd9ce-a15b-4db5-b7a1-200ce0e77759","Type":"ContainerStarted","Data":"dd2954958f45cf82a72dfa70a89678e9fb49948b4dcbe143d49a6f19ce38623d"} May 26 10:12:17.788046 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:17.788007 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rt42" event={"ID":"911fd9ce-a15b-4db5-b7a1-200ce0e77759","Type":"ContainerStarted","Data":"70913d3dd091ddcfc75a26625a41ecc15578fc10e2bccfacbfaa7867076286a8"} May 26 10:12:17.788046 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:17.788047 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4rt42" event={"ID":"911fd9ce-a15b-4db5-b7a1-200ce0e77759","Type":"ContainerStarted","Data":"7e9bbb1c6c68ddb7a47ab02618a819880cfc3281977953fe7003ca1c298e5841"} May 26 10:12:17.803672 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:17.803600 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4rt42" podStartSLOduration=131.402314491 podStartE2EDuration="2m12.803581726s" podCreationTimestamp="2026-05-26 10:10:05 +0000 UTC" firstStartedPulling="2026-05-26 10:12:15.354110704 +0000 UTC m=+130.750219834" lastFinishedPulling="2026-05-26 10:12:16.755377954 +0000 UTC m=+132.151487069" observedRunningTime="2026-05-26 10:12:17.802153972 +0000 UTC m=+133.198263122" watchObservedRunningTime="2026-05-26 10:12:17.803581726 +0000 UTC m=+133.199690866" May 26 10:12:19.312209 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:19.312160 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" podUID="89a1bfd6-35f7-4876-88c5-2a9c9a4a0398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 26 10:12:29.312563 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:29.312523 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" podUID="89a1bfd6-35f7-4876-88c5-2a9c9a4a0398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 26 10:12:30.828120 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:30.828080 2559 generic.go:358] "Generic (PLEG): container finished" podID="3f4534f1-7047-4944-b6f6-ecea9352ed74" containerID="315af68fbc16c27dbe77bca318bf03a932249811a57d97928f3987b5fb76ed8e" exitCode=0 May 26 10:12:30.828120 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:30.828123 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" event={"ID":"3f4534f1-7047-4944-b6f6-ecea9352ed74","Type":"ContainerDied","Data":"315af68fbc16c27dbe77bca318bf03a932249811a57d97928f3987b5fb76ed8e"} May 26 10:12:30.828568 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:30.828442 2559 scope.go:117] "RemoveContainer" containerID="315af68fbc16c27dbe77bca318bf03a932249811a57d97928f3987b5fb76ed8e" May 26 10:12:31.832161 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:31.832125 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-74z5c" event={"ID":"3f4534f1-7047-4944-b6f6-ecea9352ed74","Type":"ContainerStarted","Data":"1c637bc2b5e8c4b14a21d11436a7eda2413cb44b43a5ea1bbadd758f5516ce2a"} May 26 10:12:39.311932 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.311885 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" podUID="89a1bfd6-35f7-4876-88c5-2a9c9a4a0398" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 26 10:12:39.312366 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.311970 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" May 26 10:12:39.312507 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.312488 2559 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"52ca5d0ebdae2564dd62dd3ceee60ed45bafff9a17a22363845f248f7bf3a5c4"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 26 10:12:39.312545 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.312527 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" podUID="89a1bfd6-35f7-4876-88c5-2a9c9a4a0398" containerName="service-proxy" containerID="cri-o://52ca5d0ebdae2564dd62dd3ceee60ed45bafff9a17a22363845f248f7bf3a5c4" gracePeriod=30 May 26 10:12:39.858617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.858581 2559 generic.go:358] "Generic (PLEG): container finished" podID="89a1bfd6-35f7-4876-88c5-2a9c9a4a0398" containerID="52ca5d0ebdae2564dd62dd3ceee60ed45bafff9a17a22363845f248f7bf3a5c4" exitCode=2 May 26 10:12:39.858833 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.858658 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerDied","Data":"52ca5d0ebdae2564dd62dd3ceee60ed45bafff9a17a22363845f248f7bf3a5c4"} May 26 10:12:39.858833 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:12:39.858702 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8689499989-rbxc7" event={"ID":"89a1bfd6-35f7-4876-88c5-2a9c9a4a0398","Type":"ContainerStarted","Data":"c5515a63f2663ddc7890626011051dcb61591066da8e5c23295fc4f518195fc0"} May 26 10:15:05.065605 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:15:05.065577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:15:05.067056 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:15:05.067026 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:15:05.069879 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:15:05.069858 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:15:05.070942 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:15:05.070911 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:15:05.075741 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:15:05.075725 2559 kubelet.go:1628] "Image garbage collection succeeded" May 26 10:20:05.086822 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:20:05.086797 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:20:05.087466 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:20:05.087442 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:20:05.091097 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:20:05.091078 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:20:05.091767 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:20:05.091752 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:23:30.741987 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.741949 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct"] May 26 10:23:30.742438 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.742225 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerName="registry" May 26 10:23:30.742438 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.742236 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerName="registry" May 26 10:23:30.742438 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.742290 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a6ca47b-b6d0-4785-876e-0f20565b6abb" containerName="registry" May 26 10:23:30.745000 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.744984 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.747035 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.747009 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 26 10:23:30.747171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.747044 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dw9bs\"" May 26 10:23:30.747171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.747083 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 26 10:23:30.747171 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.747151 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 26 10:23:30.747383 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.747368 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 26 10:23:30.766298 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.766267 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct"] May 26 10:23:30.840908 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.840864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.841104 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.840936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xr55\" (UniqueName: \"kubernetes.io/projected/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-kube-api-access-2xr55\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.841104 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.840991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.942221 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.942182 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.942221 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.942228 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.942439 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.942271 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr55\" (UniqueName: \"kubernetes.io/projected/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-kube-api-access-2xr55\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.944810 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.944778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.944924 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.944782 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:30.950843 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:30.950821 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xr55\" (UniqueName: \"kubernetes.io/projected/e0e8f5e5-f9b3-4032-9602-9e8c1270d223-kube-api-access-2xr55\") pod \"opendatahub-operator-controller-manager-7c66b4d846-tr9ct\" (UID: \"e0e8f5e5-f9b3-4032-9602-9e8c1270d223\") " pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:31.055804 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:31.055767 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:31.191240 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:31.191144 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct"] May 26 10:23:31.193669 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:23:31.193624 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0e8f5e5_f9b3_4032_9602_9e8c1270d223.slice/crio-3fd7b9555f3bf1c4e20f7141b07f1ce8b9717763b7c6b073de01e8f7bedfab8b WatchSource:0}: Error finding container 3fd7b9555f3bf1c4e20f7141b07f1ce8b9717763b7c6b073de01e8f7bedfab8b: Status 404 returned error can't find the container with id 3fd7b9555f3bf1c4e20f7141b07f1ce8b9717763b7c6b073de01e8f7bedfab8b May 26 10:23:31.195247 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:31.195228 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:23:31.690727 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:31.690689 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" event={"ID":"e0e8f5e5-f9b3-4032-9602-9e8c1270d223","Type":"ContainerStarted","Data":"3fd7b9555f3bf1c4e20f7141b07f1ce8b9717763b7c6b073de01e8f7bedfab8b"} May 26 10:23:34.705565 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:34.705527 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" event={"ID":"e0e8f5e5-f9b3-4032-9602-9e8c1270d223","Type":"ContainerStarted","Data":"2851a9966017582f52e4bad61c80be80e6a827acdbbe98a10313306628f9556d"} May 26 10:23:34.705965 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:34.705696 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:34.723951 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:34.723876 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" podStartSLOduration=2.134764636 podStartE2EDuration="4.723859838s" podCreationTimestamp="2026-05-26 10:23:30 +0000 UTC" firstStartedPulling="2026-05-26 10:23:31.195390948 +0000 UTC m=+806.591500064" lastFinishedPulling="2026-05-26 10:23:33.784486149 +0000 UTC m=+809.180595266" observedRunningTime="2026-05-26 10:23:34.72248787 +0000 UTC m=+810.118597007" watchObservedRunningTime="2026-05-26 10:23:34.723859838 +0000 UTC m=+810.119968974" May 26 10:23:45.711785 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:45.711755 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c66b4d846-tr9ct" May 26 10:23:48.408746 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.408702 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-g5v86"] May 26 10:23:48.413819 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.413790 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.416775 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.416266 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" May 26 10:23:48.416775 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.416476 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nfh9c\"" May 26 10:23:48.416970 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.416792 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" May 26 10:23:48.417852 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.417807 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-g5v86"] May 26 10:23:48.466980 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.466947 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ce0b14-b67e-4182-9e22-66fa630a16f0-tls-certs\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.467127 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.467017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nljvz\" (UniqueName: \"kubernetes.io/projected/81ce0b14-b67e-4182-9e22-66fa630a16f0-kube-api-access-nljvz\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.467127 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.467065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ce0b14-b67e-4182-9e22-66fa630a16f0-tmp\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.567673 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.567614 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ce0b14-b67e-4182-9e22-66fa630a16f0-tls-certs\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.567812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.567718 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nljvz\" (UniqueName: \"kubernetes.io/projected/81ce0b14-b67e-4182-9e22-66fa630a16f0-kube-api-access-nljvz\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.567812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.567750 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ce0b14-b67e-4182-9e22-66fa630a16f0-tmp\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.570120 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.570088 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81ce0b14-b67e-4182-9e22-66fa630a16f0-tmp\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.570310 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.570292 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81ce0b14-b67e-4182-9e22-66fa630a16f0-tls-certs\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.575567 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.575547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nljvz\" (UniqueName: \"kubernetes.io/projected/81ce0b14-b67e-4182-9e22-66fa630a16f0-kube-api-access-nljvz\") pod \"kube-auth-proxy-546bd7d749-g5v86\" (UID: \"81ce0b14-b67e-4182-9e22-66fa630a16f0\") " pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.724750 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.724625 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" May 26 10:23:48.856132 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:48.855953 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-546bd7d749-g5v86"] May 26 10:23:48.858890 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:23:48.858864 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ce0b14_b67e_4182_9e22_66fa630a16f0.slice/crio-6e66cecee1445331f8af6775ccfaa12cb55301ee478689816c97ea2b5cc4d9f7 WatchSource:0}: Error finding container 6e66cecee1445331f8af6775ccfaa12cb55301ee478689816c97ea2b5cc4d9f7: Status 404 returned error can't find the container with id 6e66cecee1445331f8af6775ccfaa12cb55301ee478689816c97ea2b5cc4d9f7 May 26 10:23:49.754187 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:49.754150 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" event={"ID":"81ce0b14-b67e-4182-9e22-66fa630a16f0","Type":"ContainerStarted","Data":"6e66cecee1445331f8af6775ccfaa12cb55301ee478689816c97ea2b5cc4d9f7"} May 26 10:23:52.009174 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.009140 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9jrd5"] May 26 10:23:52.012235 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.012219 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.014303 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.014282 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xvtnq\"" May 26 10:23:52.014432 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.014412 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" May 26 10:23:52.020859 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.020834 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9jrd5"] May 26 10:23:52.098215 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.098182 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88wkb\" (UniqueName: \"kubernetes.io/projected/592cb579-e2ea-449d-8f8a-f0a45e2858a1-kube-api-access-88wkb\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.098379 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.098228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.199472 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.199429 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88wkb\" (UniqueName: \"kubernetes.io/projected/592cb579-e2ea-449d-8f8a-f0a45e2858a1-kube-api-access-88wkb\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.199677 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.199483 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.199677 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:52.199606 2559 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found May 26 10:23:52.199773 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:52.199691 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert podName:592cb579-e2ea-449d-8f8a-f0a45e2858a1 nodeName:}" failed. No retries permitted until 2026-05-26 10:23:52.6996678 +0000 UTC m=+828.095776915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert") pod "odh-model-controller-858dbf95b8-9jrd5" (UID: "592cb579-e2ea-449d-8f8a-f0a45e2858a1") : secret "odh-model-controller-webhook-cert" not found May 26 10:23:52.208440 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.208408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88wkb\" (UniqueName: \"kubernetes.io/projected/592cb579-e2ea-449d-8f8a-f0a45e2858a1-kube-api-access-88wkb\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.703886 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.703847 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.706394 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.706375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/592cb579-e2ea-449d-8f8a-f0a45e2858a1-cert\") pod \"odh-model-controller-858dbf95b8-9jrd5\" (UID: \"592cb579-e2ea-449d-8f8a-f0a45e2858a1\") " pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:52.766755 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.766722 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" event={"ID":"81ce0b14-b67e-4182-9e22-66fa630a16f0","Type":"ContainerStarted","Data":"b47f0c45315de84b3f80e9c96c7aba146c7b874bccd8f8bc020193116e1f55b9"} May 26 10:23:52.782141 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.782061 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-546bd7d749-g5v86" podStartSLOduration=1.61910666 podStartE2EDuration="4.782044913s" podCreationTimestamp="2026-05-26 10:23:48 +0000 UTC" firstStartedPulling="2026-05-26 10:23:48.860615691 +0000 UTC m=+824.256724805" lastFinishedPulling="2026-05-26 10:23:52.023553927 +0000 UTC m=+827.419663058" observedRunningTime="2026-05-26 10:23:52.78133345 +0000 UTC m=+828.177442587" watchObservedRunningTime="2026-05-26 10:23:52.782044913 +0000 UTC m=+828.178154053" May 26 10:23:52.924303 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:52.924265 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:23:53.054838 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:53.054797 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-9jrd5"] May 26 10:23:53.057180 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:23:53.057155 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592cb579_e2ea_449d_8f8a_f0a45e2858a1.slice/crio-35c7363953e4fc5bfb12bf8b282a1f2d60ba91f249a741971a9ef9b1861bc5ce WatchSource:0}: Error finding container 35c7363953e4fc5bfb12bf8b282a1f2d60ba91f249a741971a9ef9b1861bc5ce: Status 404 returned error can't find the container with id 35c7363953e4fc5bfb12bf8b282a1f2d60ba91f249a741971a9ef9b1861bc5ce May 26 10:23:53.771348 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:53.771277 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" event={"ID":"592cb579-e2ea-449d-8f8a-f0a45e2858a1","Type":"ContainerStarted","Data":"35c7363953e4fc5bfb12bf8b282a1f2d60ba91f249a741971a9ef9b1861bc5ce"} May 26 10:23:56.784587 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:56.784552 2559 generic.go:358] "Generic (PLEG): container finished" podID="592cb579-e2ea-449d-8f8a-f0a45e2858a1" containerID="0693969e246615224f1dabc2f04818382dce4ac0f2dc88c9a450700c6e017609" exitCode=1 May 26 10:23:56.784984 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:56.784664 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" event={"ID":"592cb579-e2ea-449d-8f8a-f0a45e2858a1","Type":"ContainerDied","Data":"0693969e246615224f1dabc2f04818382dce4ac0f2dc88c9a450700c6e017609"} May 26 10:23:56.784984 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:56.784861 2559 scope.go:117] "RemoveContainer" containerID="0693969e246615224f1dabc2f04818382dce4ac0f2dc88c9a450700c6e017609" May 26 10:23:57.424799 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.424708 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7xwcb"] May 26 10:23:57.428323 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.428303 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.430418 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.430393 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-z85ts\"" May 26 10:23:57.430520 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.430428 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" May 26 10:23:57.435397 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.435371 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7xwcb"] May 26 10:23:57.544934 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.544903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s72dq\" (UniqueName: \"kubernetes.io/projected/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-kube-api-access-s72dq\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.545098 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.544951 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.646448 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.646414 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s72dq\" (UniqueName: \"kubernetes.io/projected/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-kube-api-access-s72dq\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.646671 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.646461 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.646671 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:57.646564 2559 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found May 26 10:23:57.646671 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:57.646618 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert podName:50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3 nodeName:}" failed. No retries permitted until 2026-05-26 10:23:58.146601702 +0000 UTC m=+833.542710817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert") pod "kserve-controller-manager-856948b99f-7xwcb" (UID: "50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3") : secret "kserve-webhook-server-cert" not found May 26 10:23:57.668932 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.668899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s72dq\" (UniqueName: \"kubernetes.io/projected/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-kube-api-access-s72dq\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:57.789319 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.789277 2559 generic.go:358] "Generic (PLEG): container finished" podID="592cb579-e2ea-449d-8f8a-f0a45e2858a1" containerID="c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8" exitCode=1 May 26 10:23:57.789848 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.789338 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" event={"ID":"592cb579-e2ea-449d-8f8a-f0a45e2858a1","Type":"ContainerDied","Data":"c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8"} May 26 10:23:57.789848 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.789385 2559 scope.go:117] "RemoveContainer" containerID="0693969e246615224f1dabc2f04818382dce4ac0f2dc88c9a450700c6e017609" May 26 10:23:57.789848 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:57.789701 2559 scope.go:117] "RemoveContainer" containerID="c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8" May 26 10:23:57.789997 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:57.789937 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9jrd5_opendatahub(592cb579-e2ea-449d-8f8a-f0a45e2858a1)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" podUID="592cb579-e2ea-449d-8f8a-f0a45e2858a1" May 26 10:23:58.151103 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.151014 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:58.153595 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.153566 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3-cert\") pod \"kserve-controller-manager-856948b99f-7xwcb\" (UID: \"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3\") " pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:58.340524 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.340478 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:23:58.474263 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.470663 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7xwcb"] May 26 10:23:58.794192 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.794151 2559 scope.go:117] "RemoveContainer" containerID="c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8" May 26 10:23:58.794679 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:23:58.794419 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9jrd5_opendatahub(592cb579-e2ea-449d-8f8a-f0a45e2858a1)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" podUID="592cb579-e2ea-449d-8f8a-f0a45e2858a1" May 26 10:23:58.795264 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:23:58.795243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" event={"ID":"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3","Type":"ContainerStarted","Data":"3de42244735387162bc3bc01251acd6ceb456fd5e5c1817f6a95f2b7906df1e7"} May 26 10:24:02.809280 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:02.809243 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" event={"ID":"50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3","Type":"ContainerStarted","Data":"b400df6df14951131754f0ce7010dd962e79f6f778201cb7fd52f25b749cd8a7"} May 26 10:24:02.809755 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:02.809476 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:24:02.844041 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:02.843966 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" podStartSLOduration=2.343819398 podStartE2EDuration="5.843950427s" podCreationTimestamp="2026-05-26 10:23:57 +0000 UTC" firstStartedPulling="2026-05-26 10:23:58.476797413 +0000 UTC m=+833.872906528" lastFinishedPulling="2026-05-26 10:24:01.976928418 +0000 UTC m=+837.373037557" observedRunningTime="2026-05-26 10:24:02.843181501 +0000 UTC m=+838.239290638" watchObservedRunningTime="2026-05-26 10:24:02.843950427 +0000 UTC m=+838.240059603" May 26 10:24:02.924550 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:02.924517 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:24:02.924972 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:02.924955 2559 scope.go:117] "RemoveContainer" containerID="c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8" May 26 10:24:02.925177 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:24:02.925157 2559 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-9jrd5_opendatahub(592cb579-e2ea-449d-8f8a-f0a45e2858a1)\"" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" podUID="592cb579-e2ea-449d-8f8a-f0a45e2858a1" May 26 10:24:03.134247 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.134151 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h"] May 26 10:24:03.137701 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.137679 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.139768 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.139745 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-rr4ml\"" May 26 10:24:03.139991 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.139977 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" May 26 10:24:03.140083 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.140063 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" May 26 10:24:03.155814 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.155782 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h"] May 26 10:24:03.192926 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.192892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.193069 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.192959 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfjpp\" (UniqueName: \"kubernetes.io/projected/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-kube-api-access-cfjpp\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.294376 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.294339 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfjpp\" (UniqueName: \"kubernetes.io/projected/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-kube-api-access-cfjpp\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.294608 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.294553 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.297156 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.297138 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-operator-config\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.304913 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.304891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfjpp\" (UniqueName: \"kubernetes.io/projected/47b99e4d-efdc-4fda-b2b5-86e58b3f823b-kube-api-access-cfjpp\") pod \"servicemesh-operator3-55f49c5f94-vdx8h\" (UID: \"47b99e4d-efdc-4fda-b2b5-86e58b3f823b\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.447080 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.446989 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:03.587162 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.587137 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h"] May 26 10:24:03.590188 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:24:03.590156 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b99e4d_efdc_4fda_b2b5_86e58b3f823b.slice/crio-4bd768cc40e0ec58c43b98f5ab5f99a68aa94760c2ba36b3b9c2c7940e35df1c WatchSource:0}: Error finding container 4bd768cc40e0ec58c43b98f5ab5f99a68aa94760c2ba36b3b9c2c7940e35df1c: Status 404 returned error can't find the container with id 4bd768cc40e0ec58c43b98f5ab5f99a68aa94760c2ba36b3b9c2c7940e35df1c May 26 10:24:03.813271 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:03.813235 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" event={"ID":"47b99e4d-efdc-4fda-b2b5-86e58b3f823b","Type":"ContainerStarted","Data":"4bd768cc40e0ec58c43b98f5ab5f99a68aa94760c2ba36b3b9c2c7940e35df1c"} May 26 10:24:12.925205 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:12.925169 2559 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:24:12.925708 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:12.925692 2559 scope.go:117] "RemoveContainer" containerID="c27a31eedf63a11b8ec9ea128d00ee7f5d77e58855d22e0e825b7e8eaf639de8" May 26 10:24:13.849886 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.849827 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" event={"ID":"47b99e4d-efdc-4fda-b2b5-86e58b3f823b","Type":"ContainerStarted","Data":"0b1a0537f3725fb287a2e9839a46d22e3af771bd85502e6918722cf28c02b460"} May 26 10:24:13.850097 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.849919 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:13.851989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.851963 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" event={"ID":"592cb579-e2ea-449d-8f8a-f0a45e2858a1","Type":"ContainerStarted","Data":"8c580108f9786c51fa60e824394d221c30175e361b3cc8d7d2bf0da53e605501"} May 26 10:24:13.852231 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.852215 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:24:13.876485 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.876441 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" podStartSLOduration=1.171937751 podStartE2EDuration="10.876428792s" podCreationTimestamp="2026-05-26 10:24:03 +0000 UTC" firstStartedPulling="2026-05-26 10:24:03.592859157 +0000 UTC m=+838.988968272" lastFinishedPulling="2026-05-26 10:24:13.297350184 +0000 UTC m=+848.693459313" observedRunningTime="2026-05-26 10:24:13.875230757 +0000 UTC m=+849.271339887" watchObservedRunningTime="2026-05-26 10:24:13.876428792 +0000 UTC m=+849.272537928" May 26 10:24:13.903368 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:13.903314 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" podStartSLOduration=2.664968331 podStartE2EDuration="22.903297958s" podCreationTimestamp="2026-05-26 10:23:51 +0000 UTC" firstStartedPulling="2026-05-26 10:23:53.058508795 +0000 UTC m=+828.454617914" lastFinishedPulling="2026-05-26 10:24:13.296838427 +0000 UTC m=+848.692947541" observedRunningTime="2026-05-26 10:24:13.899739339 +0000 UTC m=+849.295848477" watchObservedRunningTime="2026-05-26 10:24:13.903297958 +0000 UTC m=+849.299407095" May 26 10:24:14.223325 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.223230 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5"] May 26 10:24:14.226901 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.226882 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.228707 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.228676 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" May 26 10:24:14.228826 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.228729 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 26 10:24:14.228826 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.228818 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" May 26 10:24:14.228957 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.228945 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cms9t\"" May 26 10:24:14.228957 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.228953 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" May 26 10:24:14.251660 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.251604 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5"] May 26 10:24:14.291829 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.291795 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292009 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.291940 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287c278e-9902-4c9c-a3de-70d25f08fcf1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292009 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.291972 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nwbw\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-kube-api-access-9nwbw\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292096 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.292048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292136 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.292119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292188 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.292174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.292223 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.292204 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393260 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393212 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287c278e-9902-4c9c-a3de-70d25f08fcf1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393260 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393262 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9nwbw\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-kube-api-access-9nwbw\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393491 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393297 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393491 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393327 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393491 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393351 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393491 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393378 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.393491 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.393426 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.394155 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.394126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.395954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.395901 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.395954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.395929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-cacerts\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.396136 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.396115 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/287c278e-9902-4c9c-a3de-70d25f08fcf1-local-certs\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.396288 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.396270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.401117 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.401093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nwbw\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-kube-api-access-9nwbw\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.401513 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.401493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/287c278e-9902-4c9c-a3de-70d25f08fcf1-istio-token\") pod \"istiod-openshift-gateway-798958bb55-mqcx5\" (UID: \"287c278e-9902-4c9c-a3de-70d25f08fcf1\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.536906 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.536874 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:14.689567 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.689441 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5"] May 26 10:24:14.692530 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:24:14.692496 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287c278e_9902_4c9c_a3de_70d25f08fcf1.slice/crio-342f02a490af1a4f691a662674319806fb2d354b7dac13454627613727e3154e WatchSource:0}: Error finding container 342f02a490af1a4f691a662674319806fb2d354b7dac13454627613727e3154e: Status 404 returned error can't find the container with id 342f02a490af1a4f691a662674319806fb2d354b7dac13454627613727e3154e May 26 10:24:14.857517 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:14.857364 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" event={"ID":"287c278e-9902-4c9c-a3de-70d25f08fcf1","Type":"ContainerStarted","Data":"342f02a490af1a4f691a662674319806fb2d354b7dac13454627613727e3154e"} May 26 10:24:17.288940 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:17.288902 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 26 10:24:17.289230 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:17.288977 2559 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} May 26 10:24:17.871379 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:17.871338 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" event={"ID":"287c278e-9902-4c9c-a3de-70d25f08fcf1","Type":"ContainerStarted","Data":"815fd91d3ef18233b6e8223865273b0e1aab86608e196a5ba4224a60fb02e7e7"} May 26 10:24:17.872151 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:17.872123 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:17.896996 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:17.896929 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" podStartSLOduration=1.302899625 podStartE2EDuration="3.896909233s" podCreationTimestamp="2026-05-26 10:24:14 +0000 UTC" firstStartedPulling="2026-05-26 10:24:14.694653653 +0000 UTC m=+850.090762768" lastFinishedPulling="2026-05-26 10:24:17.288663246 +0000 UTC m=+852.684772376" observedRunningTime="2026-05-26 10:24:17.894309618 +0000 UTC m=+853.290418756" watchObservedRunningTime="2026-05-26 10:24:17.896909233 +0000 UTC m=+853.293018372" May 26 10:24:18.877184 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:18.877148 2559 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-mqcx5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= May 26 10:24:18.877671 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:18.877208 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" podUID="287c278e-9902-4c9c-a3de-70d25f08fcf1" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 26 10:24:19.879749 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:19.879721 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-mqcx5" May 26 10:24:24.859421 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:24.859389 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-9jrd5" May 26 10:24:24.859901 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:24.859447 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-vdx8h" May 26 10:24:33.819240 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:24:33.819209 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-7xwcb" May 26 10:25:05.110180 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:05.110100 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:25:05.112101 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:05.112073 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:25:05.114729 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:05.114707 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:25:05.116380 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:05.116355 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:25:28.476397 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.476361 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cknbw"] May 26 10:25:28.483152 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.483122 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:28.485791 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.485767 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" May 26 10:25:28.486488 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.486466 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" May 26 10:25:28.486597 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.486466 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-s827v\"" May 26 10:25:28.500277 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.500254 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cknbw"] May 26 10:25:28.612848 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.612807 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5cpp\" (UniqueName: \"kubernetes.io/projected/ecddb1d9-0fac-4034-8664-770c2c059cb0-kube-api-access-v5cpp\") pod \"authorino-operator-657f44b778-cknbw\" (UID: \"ecddb1d9-0fac-4034-8664-770c2c059cb0\") " pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:28.713895 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.713850 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5cpp\" (UniqueName: \"kubernetes.io/projected/ecddb1d9-0fac-4034-8664-770c2c059cb0-kube-api-access-v5cpp\") pod \"authorino-operator-657f44b778-cknbw\" (UID: \"ecddb1d9-0fac-4034-8664-770c2c059cb0\") " pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:28.725323 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.725284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5cpp\" (UniqueName: \"kubernetes.io/projected/ecddb1d9-0fac-4034-8664-770c2c059cb0-kube-api-access-v5cpp\") pod \"authorino-operator-657f44b778-cknbw\" (UID: \"ecddb1d9-0fac-4034-8664-770c2c059cb0\") " pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:28.793319 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.793288 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:28.932337 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:28.932296 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-cknbw"] May 26 10:25:28.935644 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:25:28.935593 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecddb1d9_0fac_4034_8664_770c2c059cb0.slice/crio-ac4708c20c04eb788fea198cb6df39700058d75fc514b1ba4a3415a5a37250c2 WatchSource:0}: Error finding container ac4708c20c04eb788fea198cb6df39700058d75fc514b1ba4a3415a5a37250c2: Status 404 returned error can't find the container with id ac4708c20c04eb788fea198cb6df39700058d75fc514b1ba4a3415a5a37250c2 May 26 10:25:29.111168 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:29.111084 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" event={"ID":"ecddb1d9-0fac-4034-8664-770c2c059cb0","Type":"ContainerStarted","Data":"ac4708c20c04eb788fea198cb6df39700058d75fc514b1ba4a3415a5a37250c2"} May 26 10:25:32.122163 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:32.122124 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" event={"ID":"ecddb1d9-0fac-4034-8664-770c2c059cb0","Type":"ContainerStarted","Data":"ee5f4cf6cfa9661e30071837ce6a1f21e93a9eb742b827fa5062ecf1f145530c"} May 26 10:25:32.122563 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:32.122181 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:32.144987 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:32.144812 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" podStartSLOduration=2.014763625 podStartE2EDuration="4.144794091s" podCreationTimestamp="2026-05-26 10:25:28 +0000 UTC" firstStartedPulling="2026-05-26 10:25:28.937552834 +0000 UTC m=+924.333661949" lastFinishedPulling="2026-05-26 10:25:31.0675833 +0000 UTC m=+926.463692415" observedRunningTime="2026-05-26 10:25:32.14421156 +0000 UTC m=+927.540320698" watchObservedRunningTime="2026-05-26 10:25:32.144794091 +0000 UTC m=+927.540903230" May 26 10:25:43.128756 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.128721 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-cknbw" May 26 10:25:43.479363 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.479283 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:25:43.484126 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.484098 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.486789 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.486765 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mqgln\"" May 26 10:25:43.496067 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.496043 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:25:43.638992 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.638954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64w6r\" (UniqueName: \"kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.639176 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.639006 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.740180 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.740094 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.740180 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.740171 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-64w6r\" (UniqueName: \"kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.740482 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.740463 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.754051 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.754016 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64w6r\" (UniqueName: \"kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-2d5gd\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.796566 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.796529 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:43.951797 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:43.951768 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:25:43.954548 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:25:43.954518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7dba02_c115_47c7_a821_b5a5076e7ede.slice/crio-a501626fc5bfc9b4507baa5bd911988af650b279889b02875cd88bbc10d7e94e WatchSource:0}: Error finding container a501626fc5bfc9b4507baa5bd911988af650b279889b02875cd88bbc10d7e94e: Status 404 returned error can't find the container with id a501626fc5bfc9b4507baa5bd911988af650b279889b02875cd88bbc10d7e94e May 26 10:25:44.165801 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:44.165763 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" event={"ID":"fe7dba02-c115-47c7-a821-b5a5076e7ede","Type":"ContainerStarted","Data":"a501626fc5bfc9b4507baa5bd911988af650b279889b02875cd88bbc10d7e94e"} May 26 10:25:49.184696 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:49.184661 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" event={"ID":"fe7dba02-c115-47c7-a821-b5a5076e7ede","Type":"ContainerStarted","Data":"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738"} May 26 10:25:49.185188 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:49.184778 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:25:49.206313 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:25:49.206267 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" podStartSLOduration=1.634933224 podStartE2EDuration="6.206253214s" podCreationTimestamp="2026-05-26 10:25:43 +0000 UTC" firstStartedPulling="2026-05-26 10:25:43.956870288 +0000 UTC m=+939.352979416" lastFinishedPulling="2026-05-26 10:25:48.528190277 +0000 UTC m=+943.924299406" observedRunningTime="2026-05-26 10:25:49.203667942 +0000 UTC m=+944.599777073" watchObservedRunningTime="2026-05-26 10:25:49.206253214 +0000 UTC m=+944.602362404" May 26 10:26:00.190915 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:00.190878 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:26:09.827075 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:09.827043 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:26:09.827480 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:09.827303 2559 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" podUID="fe7dba02-c115-47c7-a821-b5a5076e7ede" containerName="manager" containerID="cri-o://792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738" gracePeriod=10 May 26 10:26:10.086446 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.086381 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:26:10.164978 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.164942 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume\") pod \"fe7dba02-c115-47c7-a821-b5a5076e7ede\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " May 26 10:26:10.165147 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.164986 2559 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64w6r\" (UniqueName: \"kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r\") pod \"fe7dba02-c115-47c7-a821-b5a5076e7ede\" (UID: \"fe7dba02-c115-47c7-a821-b5a5076e7ede\") " May 26 10:26:10.165326 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.165305 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fe7dba02-c115-47c7-a821-b5a5076e7ede" (UID: "fe7dba02-c115-47c7-a821-b5a5076e7ede"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 26 10:26:10.167370 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.167347 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r" (OuterVolumeSpecName: "kube-api-access-64w6r") pod "fe7dba02-c115-47c7-a821-b5a5076e7ede" (UID: "fe7dba02-c115-47c7-a821-b5a5076e7ede"). InnerVolumeSpecName "kube-api-access-64w6r". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 26 10:26:10.254484 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.254446 2559 generic.go:358] "Generic (PLEG): container finished" podID="fe7dba02-c115-47c7-a821-b5a5076e7ede" containerID="792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738" exitCode=0 May 26 10:26:10.254670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.254516 2559 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" May 26 10:26:10.254670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.254533 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" event={"ID":"fe7dba02-c115-47c7-a821-b5a5076e7ede","Type":"ContainerDied","Data":"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738"} May 26 10:26:10.254670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.254576 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd" event={"ID":"fe7dba02-c115-47c7-a821-b5a5076e7ede","Type":"ContainerDied","Data":"a501626fc5bfc9b4507baa5bd911988af650b279889b02875cd88bbc10d7e94e"} May 26 10:26:10.254670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.254597 2559 scope.go:117] "RemoveContainer" containerID="792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738" May 26 10:26:10.263318 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.263299 2559 scope.go:117] "RemoveContainer" containerID="792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738" May 26 10:26:10.263572 ip-10-0-140-253 kubenswrapper[2559]: E0526 10:26:10.263554 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738\": container with ID starting with 792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738 not found: ID does not exist" containerID="792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738" May 26 10:26:10.263714 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.263582 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738"} err="failed to get container status \"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738\": rpc error: code = NotFound desc = could not find container \"792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738\": container with ID starting with 792aad91586668d32ed06c3ece2bd18b34a9aa3fcaaf379d41d1eeb7d276a738 not found: ID does not exist" May 26 10:26:10.265730 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.265709 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64w6r\" (UniqueName: \"kubernetes.io/projected/fe7dba02-c115-47c7-a821-b5a5076e7ede-kube-api-access-64w6r\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:26:10.265816 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.265736 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fe7dba02-c115-47c7-a821-b5a5076e7ede-extensions-socket-volume\") on node \"ip-10-0-140-253.ec2.internal\" DevicePath \"\"" May 26 10:26:10.279619 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.279590 2559 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:26:10.285746 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:10.285725 2559 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-2d5gd"] May 26 10:26:11.204728 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:11.204697 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7dba02-c115-47c7-a821-b5a5076e7ede" path="/var/lib/kubelet/pods/fe7dba02-c115-47c7-a821-b5a5076e7ede/volumes" May 26 10:26:52.144545 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.144492 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9sgpq"] May 26 10:26:52.145129 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.144852 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe7dba02-c115-47c7-a821-b5a5076e7ede" containerName="manager" May 26 10:26:52.145129 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.144864 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7dba02-c115-47c7-a821-b5a5076e7ede" containerName="manager" May 26 10:26:52.145129 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.144925 2559 memory_manager.go:356] "RemoveStaleState removing state" podUID="fe7dba02-c115-47c7-a821-b5a5076e7ede" containerName="manager" May 26 10:26:52.147702 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.147679 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.150231 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.150209 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-79lqh\"" May 26 10:26:52.150344 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.150209 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" May 26 10:26:52.157415 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.157388 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9sgpq"] May 26 10:26:52.230018 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.229985 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvcnz\" (UniqueName: \"kubernetes.io/projected/a69557c0-84d5-4b92-a2a8-cce3482686f5-kube-api-access-rvcnz\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.230183 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.230055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a69557c0-84d5-4b92-a2a8-cce3482686f5-data\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.330984 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.330945 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a69557c0-84d5-4b92-a2a8-cce3482686f5-data\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.331189 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.331009 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvcnz\" (UniqueName: \"kubernetes.io/projected/a69557c0-84d5-4b92-a2a8-cce3482686f5-kube-api-access-rvcnz\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.331405 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.331381 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a69557c0-84d5-4b92-a2a8-cce3482686f5-data\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.339415 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.339387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvcnz\" (UniqueName: \"kubernetes.io/projected/a69557c0-84d5-4b92-a2a8-cce3482686f5-kube-api-access-rvcnz\") pod \"postgres-68c4fbbd6f-9sgpq\" (UID: \"a69557c0-84d5-4b92-a2a8-cce3482686f5\") " pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.459165 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.459086 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:52.588443 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:52.588392 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-9sgpq"] May 26 10:26:52.590700 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:26:52.590668 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69557c0_84d5_4b92_a2a8_cce3482686f5.slice/crio-82af8a41e1a63279050148fe6a4b0d6e4a845bf772336cff04da6b99b0ffd11b WatchSource:0}: Error finding container 82af8a41e1a63279050148fe6a4b0d6e4a845bf772336cff04da6b99b0ffd11b: Status 404 returned error can't find the container with id 82af8a41e1a63279050148fe6a4b0d6e4a845bf772336cff04da6b99b0ffd11b May 26 10:26:53.399577 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:53.399541 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" event={"ID":"a69557c0-84d5-4b92-a2a8-cce3482686f5","Type":"ContainerStarted","Data":"82af8a41e1a63279050148fe6a4b0d6e4a845bf772336cff04da6b99b0ffd11b"} May 26 10:26:58.420327 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:58.420288 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" event={"ID":"a69557c0-84d5-4b92-a2a8-cce3482686f5","Type":"ContainerStarted","Data":"e7fa0a56ba93ddba47f0bca892999b67526d67456157f218c6e083b0ad6574c5"} May 26 10:26:58.420867 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:58.420437 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:26:58.438905 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:26:58.438855 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" podStartSLOduration=1.362119022 podStartE2EDuration="6.438841141s" podCreationTimestamp="2026-05-26 10:26:52 +0000 UTC" firstStartedPulling="2026-05-26 10:26:52.59189777 +0000 UTC m=+1007.988006885" lastFinishedPulling="2026-05-26 10:26:57.668619888 +0000 UTC m=+1013.064729004" observedRunningTime="2026-05-26 10:26:58.437411871 +0000 UTC m=+1013.833521009" watchObservedRunningTime="2026-05-26 10:26:58.438841141 +0000 UTC m=+1013.834950278" May 26 10:27:04.454344 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:04.454315 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-9sgpq" May 26 10:27:59.093429 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.093342 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg"] May 26 10:27:59.096947 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.096931 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.099919 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.099889 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b87sc\"" May 26 10:27:59.100045 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.099889 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" May 26 10:27:59.100045 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.099892 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" May 26 10:27:59.100045 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.099901 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" May 26 10:27:59.108873 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.108850 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg"] May 26 10:27:59.199790 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.199759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.199960 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.199806 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.199960 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.199858 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhpzx\" (UniqueName: \"kubernetes.io/projected/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kube-api-access-nhpzx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.199960 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.199936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.200128 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.200016 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.200128 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.200051 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301186 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301145 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301194 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301227 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301267 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhpzx\" (UniqueName: \"kubernetes.io/projected/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kube-api-access-nhpzx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301300 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301341 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301673 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301607 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301771 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.301927 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.301900 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.303758 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.303739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.303957 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.303940 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.308817 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.308798 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhpzx\" (UniqueName: \"kubernetes.io/projected/8d94cc94-5971-47e7-bdc4-f2dc571fd26a-kube-api-access-nhpzx\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg\" (UID: \"8d94cc94-5971-47e7-bdc4-f2dc571fd26a\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.406767 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.406687 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:27:59.552030 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.551909 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg"] May 26 10:27:59.554455 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:27:59.554424 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d94cc94_5971_47e7_bdc4_f2dc571fd26a.slice/crio-a36a650cc479f86ad844e5d2de1875a98cf6acf6084e3f750e02a8db464ba257 WatchSource:0}: Error finding container a36a650cc479f86ad844e5d2de1875a98cf6acf6084e3f750e02a8db464ba257: Status 404 returned error can't find the container with id a36a650cc479f86ad844e5d2de1875a98cf6acf6084e3f750e02a8db464ba257 May 26 10:27:59.628664 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:27:59.628616 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" event={"ID":"8d94cc94-5971-47e7-bdc4-f2dc571fd26a","Type":"ContainerStarted","Data":"a36a650cc479f86ad844e5d2de1875a98cf6acf6084e3f750e02a8db464ba257"} May 26 10:28:06.656853 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:06.656812 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" event={"ID":"8d94cc94-5971-47e7-bdc4-f2dc571fd26a","Type":"ContainerStarted","Data":"952308ef4c191236c18e6af80bf48fe5de6645db22de6c52698b9b24068d76cc"} May 26 10:28:14.688931 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:14.688837 2559 generic.go:358] "Generic (PLEG): container finished" podID="8d94cc94-5971-47e7-bdc4-f2dc571fd26a" containerID="952308ef4c191236c18e6af80bf48fe5de6645db22de6c52698b9b24068d76cc" exitCode=0 May 26 10:28:14.688931 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:14.688914 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" event={"ID":"8d94cc94-5971-47e7-bdc4-f2dc571fd26a","Type":"ContainerDied","Data":"952308ef4c191236c18e6af80bf48fe5de6645db22de6c52698b9b24068d76cc"} May 26 10:28:16.697539 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:16.697501 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" event={"ID":"8d94cc94-5971-47e7-bdc4-f2dc571fd26a","Type":"ContainerStarted","Data":"f3f0d0747cdc9223a406e5a03751dac1f4194495c937b42c0823bcfd68a75633"} May 26 10:28:16.697963 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:16.697702 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:28:16.717528 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:16.717467 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" podStartSLOduration=1.353058721 podStartE2EDuration="17.717448591s" podCreationTimestamp="2026-05-26 10:27:59 +0000 UTC" firstStartedPulling="2026-05-26 10:27:59.556377271 +0000 UTC m=+1074.952486398" lastFinishedPulling="2026-05-26 10:28:15.92076715 +0000 UTC m=+1091.316876268" observedRunningTime="2026-05-26 10:28:16.715715437 +0000 UTC m=+1092.111824588" watchObservedRunningTime="2026-05-26 10:28:16.717448591 +0000 UTC m=+1092.113557729" May 26 10:28:21.829787 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:21.829751 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg"] May 26 10:28:21.833937 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:21.833920 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:21.836201 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:21.836180 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" May 26 10:28:21.846439 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:21.846395 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg"] May 26 10:28:22.011823 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.011783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.011823 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.011824 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.012082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.011847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.012082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.011943 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.012082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.012007 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7psm\" (UniqueName: \"kubernetes.io/projected/26188bea-c1e9-4530-8afe-eeeed0335b47-kube-api-access-x7psm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.012082 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.012040 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26188bea-c1e9-4530-8afe-eeeed0335b47-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.112866 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112777 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7psm\" (UniqueName: \"kubernetes.io/projected/26188bea-c1e9-4530-8afe-eeeed0335b47-kube-api-access-x7psm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.112866 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112821 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26188bea-c1e9-4530-8afe-eeeed0335b47-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112878 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112894 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112922 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113099 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.112970 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113364 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.113255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113364 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.113337 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.113451 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.113368 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.115384 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.115365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/26188bea-c1e9-4530-8afe-eeeed0335b47-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.115578 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.115558 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26188bea-c1e9-4530-8afe-eeeed0335b47-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.121794 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.121751 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7psm\" (UniqueName: \"kubernetes.io/projected/26188bea-c1e9-4530-8afe-eeeed0335b47-kube-api-access-x7psm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-5bsbg\" (UID: \"26188bea-c1e9-4530-8afe-eeeed0335b47\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.144747 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.144715 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:22.289996 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.289971 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg"] May 26 10:28:22.292339 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:28:22.292313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26188bea_c1e9_4530_8afe_eeeed0335b47.slice/crio-4a80eb0e5c9d7b06d2e5d2c268af6e518245682197e2edcab9057c4c2a8356d2 WatchSource:0}: Error finding container 4a80eb0e5c9d7b06d2e5d2c268af6e518245682197e2edcab9057c4c2a8356d2: Status 404 returned error can't find the container with id 4a80eb0e5c9d7b06d2e5d2c268af6e518245682197e2edcab9057c4c2a8356d2 May 26 10:28:22.687380 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.687300 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr"] May 26 10:28:22.703829 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.703789 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.705894 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.705874 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" May 26 10:28:22.709801 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.709777 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr"] May 26 10:28:22.719691 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.719661 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" event={"ID":"26188bea-c1e9-4530-8afe-eeeed0335b47","Type":"ContainerStarted","Data":"e64749573b55cdc82f6da518691e74709faa243a126218037748651de028c7c5"} May 26 10:28:22.719803 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.719695 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" event={"ID":"26188bea-c1e9-4530-8afe-eeeed0335b47","Type":"ContainerStarted","Data":"4a80eb0e5c9d7b06d2e5d2c268af6e518245682197e2edcab9057c4c2a8356d2"} May 26 10:28:22.818127 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818080 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4mwd\" (UniqueName: \"kubernetes.io/projected/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kube-api-access-q4mwd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.818290 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.818371 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.818371 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818321 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.818498 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.818498 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.818462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919117 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4mwd\" (UniqueName: \"kubernetes.io/projected/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kube-api-access-q4mwd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919175 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919215 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919247 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919298 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919571 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919333 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919628 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919723 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.919864 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.919764 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.921691 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.921671 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.921895 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.921877 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:22.927131 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:22.927103 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4mwd\" (UniqueName: \"kubernetes.io/projected/5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26-kube-api-access-q4mwd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr\" (UID: \"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:23.016697 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:23.016588 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:23.160137 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:23.160099 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr"] May 26 10:28:23.164528 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:28:23.164497 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc8bf05_3ff2_4a75_b1f6_46ea1970cf26.slice/crio-2ca992d14a7360ee282fff2217902353ab0f0fd08c18112a2430e8cb76fc0609 WatchSource:0}: Error finding container 2ca992d14a7360ee282fff2217902353ab0f0fd08c18112a2430e8cb76fc0609: Status 404 returned error can't find the container with id 2ca992d14a7360ee282fff2217902353ab0f0fd08c18112a2430e8cb76fc0609 May 26 10:28:23.724707 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:23.724595 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" event={"ID":"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26","Type":"ContainerStarted","Data":"51f22de738435e329fd52dac40de998811dccee97283f257ca890f96de73afec"} May 26 10:28:23.724707 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:23.724660 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" event={"ID":"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26","Type":"ContainerStarted","Data":"2ca992d14a7360ee282fff2217902353ab0f0fd08c18112a2430e8cb76fc0609"} May 26 10:28:27.716613 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:27.716569 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg" May 26 10:28:28.750227 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:28.750187 2559 generic.go:358] "Generic (PLEG): container finished" podID="26188bea-c1e9-4530-8afe-eeeed0335b47" containerID="e64749573b55cdc82f6da518691e74709faa243a126218037748651de028c7c5" exitCode=0 May 26 10:28:28.750655 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:28.750240 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" event={"ID":"26188bea-c1e9-4530-8afe-eeeed0335b47","Type":"ContainerDied","Data":"e64749573b55cdc82f6da518691e74709faa243a126218037748651de028c7c5"} May 26 10:28:29.754980 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:29.754941 2559 generic.go:358] "Generic (PLEG): container finished" podID="5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26" containerID="51f22de738435e329fd52dac40de998811dccee97283f257ca890f96de73afec" exitCode=0 May 26 10:28:29.755406 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:29.755014 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" event={"ID":"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26","Type":"ContainerDied","Data":"51f22de738435e329fd52dac40de998811dccee97283f257ca890f96de73afec"} May 26 10:28:29.756802 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:29.756783 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" event={"ID":"26188bea-c1e9-4530-8afe-eeeed0335b47","Type":"ContainerStarted","Data":"6edfb007e188f0b4539d58f60ba3fb6394d405d3b88dddbb91914f3f078b8e58"} May 26 10:28:29.756989 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:29.756974 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:28:29.798114 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:29.798061 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" podStartSLOduration=8.408993872 podStartE2EDuration="8.798047335s" podCreationTimestamp="2026-05-26 10:28:21 +0000 UTC" firstStartedPulling="2026-05-26 10:28:28.750912118 +0000 UTC m=+1104.147021233" lastFinishedPulling="2026-05-26 10:28:29.13996558 +0000 UTC m=+1104.536074696" observedRunningTime="2026-05-26 10:28:29.79589548 +0000 UTC m=+1105.192004617" watchObservedRunningTime="2026-05-26 10:28:29.798047335 +0000 UTC m=+1105.194156471" May 26 10:28:30.762125 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:30.762085 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" event={"ID":"5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26","Type":"ContainerStarted","Data":"65b6d3219df81f6aa840d3b1771875595dd86379313b1b9256f850c02e070e55"} May 26 10:28:30.786538 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:30.786480 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" podStartSLOduration=8.307692721 podStartE2EDuration="8.786464575s" podCreationTimestamp="2026-05-26 10:28:22 +0000 UTC" firstStartedPulling="2026-05-26 10:28:29.755763028 +0000 UTC m=+1105.151872142" lastFinishedPulling="2026-05-26 10:28:30.234534879 +0000 UTC m=+1105.630643996" observedRunningTime="2026-05-26 10:28:30.783870867 +0000 UTC m=+1106.179980006" watchObservedRunningTime="2026-05-26 10:28:30.786464575 +0000 UTC m=+1106.182573712" May 26 10:28:40.763284 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:40.763241 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:40.781058 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:40.781022 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr" May 26 10:28:40.781346 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:28:40.781324 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-5bsbg" May 26 10:29:06.298913 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.298875 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv"] May 26 10:29:06.302452 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.302436 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.304386 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.304364 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" May 26 10:29:06.312337 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.312314 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv"] May 26 10:29:06.395800 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.395763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.395962 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.395809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.395962 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.395901 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.395962 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.395931 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjqj\" (UniqueName: \"kubernetes.io/projected/b63ea346-a75a-4342-959e-b4a99bae8a36-kube-api-access-hrjqj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.395962 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.395956 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63ea346-a75a-4342-959e-b4a99bae8a36-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.396104 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.396023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496767 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496723 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496778 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496829 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496856 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjqj\" (UniqueName: \"kubernetes.io/projected/b63ea346-a75a-4342-959e-b4a99bae8a36-kube-api-access-hrjqj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496883 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63ea346-a75a-4342-959e-b4a99bae8a36-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.496954 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.496932 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.497279 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.497183 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.497279 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.497198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.497380 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.497319 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.499551 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.499517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b63ea346-a75a-4342-959e-b4a99bae8a36-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.499551 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.499534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b63ea346-a75a-4342-959e-b4a99bae8a36-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.504065 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.504044 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjqj\" (UniqueName: \"kubernetes.io/projected/b63ea346-a75a-4342-959e-b4a99bae8a36-kube-api-access-hrjqj\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv\" (UID: \"b63ea346-a75a-4342-959e-b4a99bae8a36\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.613116 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.613028 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:06.762670 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.762578 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv"] May 26 10:29:06.764828 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:29:06.764797 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb63ea346_a75a_4342_959e_b4a99bae8a36.slice/crio-98ac095d716876bc3fad34ab05ea81955d3ff7afee4bbb8aa925e0e792405d93 WatchSource:0}: Error finding container 98ac095d716876bc3fad34ab05ea81955d3ff7afee4bbb8aa925e0e792405d93: Status 404 returned error can't find the container with id 98ac095d716876bc3fad34ab05ea81955d3ff7afee4bbb8aa925e0e792405d93 May 26 10:29:06.766623 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.766607 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:29:06.891711 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.891597 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" event={"ID":"b63ea346-a75a-4342-959e-b4a99bae8a36","Type":"ContainerStarted","Data":"3150f4e4db77e70c359aceda08e0ab97af5dcc224fde0158fd75a71c671883d7"} May 26 10:29:06.891711 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:06.891667 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" event={"ID":"b63ea346-a75a-4342-959e-b4a99bae8a36","Type":"ContainerStarted","Data":"98ac095d716876bc3fad34ab05ea81955d3ff7afee4bbb8aa925e0e792405d93"} May 26 10:29:12.912565 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:12.912527 2559 generic.go:358] "Generic (PLEG): container finished" podID="b63ea346-a75a-4342-959e-b4a99bae8a36" containerID="3150f4e4db77e70c359aceda08e0ab97af5dcc224fde0158fd75a71c671883d7" exitCode=0 May 26 10:29:12.912997 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:12.912601 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" event={"ID":"b63ea346-a75a-4342-959e-b4a99bae8a36","Type":"ContainerDied","Data":"3150f4e4db77e70c359aceda08e0ab97af5dcc224fde0158fd75a71c671883d7"} May 26 10:29:13.917835 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:13.917795 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" event={"ID":"b63ea346-a75a-4342-959e-b4a99bae8a36","Type":"ContainerStarted","Data":"c67ec0aaaf0057e9ce0906540f3a2d1d984b8472bda71bc2041fbb2018acf8ca"} May 26 10:29:13.918229 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:13.918020 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:29:13.942716 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:13.942662 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" podStartSLOduration=7.667639777 podStartE2EDuration="7.94262585s" podCreationTimestamp="2026-05-26 10:29:06 +0000 UTC" firstStartedPulling="2026-05-26 10:29:12.913241173 +0000 UTC m=+1148.309350288" lastFinishedPulling="2026-05-26 10:29:13.188227244 +0000 UTC m=+1148.584336361" observedRunningTime="2026-05-26 10:29:13.942156072 +0000 UTC m=+1149.338265220" watchObservedRunningTime="2026-05-26 10:29:13.94262585 +0000 UTC m=+1149.338734987" May 26 10:29:24.934274 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:29:24.934241 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv" May 26 10:30:05.134783 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:30:05.134750 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:30:05.138013 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:30:05.137985 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:30:05.139312 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:30:05.139294 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:30:05.142659 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:30:05.142617 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:35:05.160675 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:35:05.160626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:35:05.164193 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:35:05.164160 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:35:05.164854 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:35:05.164834 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:35:05.168796 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:35:05.168777 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:40:05.186202 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:40:05.186171 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:40:05.190322 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:40:05.190299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:40:05.190322 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:40:05.190318 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:40:05.198106 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:40:05.198084 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:45:05.213841 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:45:05.213813 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:45:05.218283 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:45:05.218253 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:45:05.219226 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:45:05.219209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:45:05.223186 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:45:05.223170 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:50:05.240438 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:50:05.240330 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:50:05.244791 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:50:05.244769 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:50:05.244931 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:50:05.244802 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:50:05.249058 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:50:05.249039 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:51:58.979826 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:51:58.979731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7xwcb_50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3/manager/0.log" May 26 10:51:59.524031 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:51:59.523999 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9jrd5_592cb579-e2ea-449d-8f8a-f0a45e2858a1/manager/2.log" May 26 10:51:59.752811 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:51:59.752778 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c66b4d846-tr9ct_e0e8f5e5-f9b3-4032-9602-9e8c1270d223/manager/0.log" May 26 10:51:59.961001 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:51:59.960912 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-9sgpq_a69557c0-84d5-4b92-a2a8-cce3482686f5/postgres/0.log" May 26 10:52:01.268995 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:01.268965 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-cknbw_ecddb1d9-0fac-4034-8664-770c2c059cb0/manager/0.log" May 26 10:52:02.366562 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:02.366526 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mqcx5_287c278e-9902-4c9c-a3de-70d25f08fcf1/discovery/0.log" May 26 10:52:02.470237 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:02.470207 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546bd7d749-g5v86_81ce0b14-b67e-4182-9e22-66fa630a16f0/kube-auth-proxy/0.log" May 26 10:52:02.909613 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:02.909574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-575fd68fbd-x59tq_0f4289b5-0a91-47bf-94a9-596d42576100/router/0.log" May 26 10:52:03.360464 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.360417 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv_b63ea346-a75a-4342-959e-b4a99bae8a36/storage-initializer/0.log" May 26 10:52:03.369579 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.369550 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-26sqv_b63ea346-a75a-4342-959e-b4a99bae8a36/main/0.log" May 26 10:52:03.472617 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.472587 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5bsbg_26188bea-c1e9-4530-8afe-eeeed0335b47/storage-initializer/0.log" May 26 10:52:03.479250 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.479226 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-5bsbg_26188bea-c1e9-4530-8afe-eeeed0335b47/main/0.log" May 26 10:52:03.582090 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.582058 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr_5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26/storage-initializer/0.log" May 26 10:52:03.588895 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.588861 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccdchzr_5fc8bf05-3ff2-4a75-b1f6-46ea1970cf26/main/0.log" May 26 10:52:03.816281 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.816241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg_8d94cc94-5971-47e7-bdc4-f2dc571fd26a/storage-initializer/0.log" May 26 10:52:03.823101 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:03.823067 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-b9ljg_8d94cc94-5971-47e7-bdc4-f2dc571fd26a/main/0.log" May 26 10:52:10.765539 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:10.765505 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wrzm5_1a077b07-f576-4f58-b23c-893b3d173175/global-pull-secret-syncer/0.log" May 26 10:52:10.884270 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:10.884243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x8jvm_b676d847-6b34-44f6-9711-01aeaf62da49/konnectivity-agent/0.log" May 26 10:52:10.953510 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:10.953481 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-253.ec2.internal_c4f0c297da793ecb55c38231a69a5ccb/haproxy/0.log" May 26 10:52:15.278164 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:15.278114 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-cknbw_ecddb1d9-0fac-4034-8664-770c2c059cb0/manager/0.log" May 26 10:52:17.219182 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:17.219142 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-lkfrv_dc7049ba-f170-4304-887a-66edfeb9b779/cluster-monitoring-operator/0.log" May 26 10:52:17.568812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:17.568779 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdznf_ebd106be-d2e3-4ee8-971a-159707da61ea/node-exporter/0.log" May 26 10:52:17.603564 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:17.603522 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdznf_ebd106be-d2e3-4ee8-971a-159707da61ea/kube-rbac-proxy/0.log" May 26 10:52:17.633786 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:17.633760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sdznf_ebd106be-d2e3-4ee8-971a-159707da61ea/init-textfile/0.log" May 26 10:52:19.214044 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.214021 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-gf9wm_33dea431-277f-44e6-8ee4-bbd8f389ebf3/networking-console-plugin/0.log" May 26 10:52:19.523183 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.523148 2559 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr"] May 26 10:52:19.526555 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.526536 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.528768 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.528744 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hzkl\"/\"kube-root-ca.crt\"" May 26 10:52:19.529191 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.529174 2559 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7hzkl\"/\"default-dockercfg-lch6v\"" May 26 10:52:19.529279 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.529211 2559 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hzkl\"/\"openshift-service-ca.crt\"" May 26 10:52:19.536789 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.536767 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr"] May 26 10:52:19.590067 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.590030 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-podres\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.590261 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.590090 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zphb\" (UniqueName: \"kubernetes.io/projected/1243b395-f7b0-4328-b60c-a6fc85e194ca-kube-api-access-5zphb\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.590261 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.590137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-proc\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.590261 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.590169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-sys\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.590261 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.590205 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-lib-modules\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691007 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.690968 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5zphb\" (UniqueName: \"kubernetes.io/projected/1243b395-f7b0-4328-b60c-a6fc85e194ca-kube-api-access-5zphb\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691201 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691015 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-proc\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691201 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691041 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-sys\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691201 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691104 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-sys\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691201 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691116 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-proc\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691213 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-lib-modules\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691349 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691294 2559 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-podres\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691417 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-lib-modules\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.691417 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.691408 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1243b395-f7b0-4328-b60c-a6fc85e194ca-podres\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.698830 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.698802 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zphb\" (UniqueName: \"kubernetes.io/projected/1243b395-f7b0-4328-b60c-a6fc85e194ca-kube-api-access-5zphb\") pod \"perf-node-gather-daemonset-vkxbr\" (UID: \"1243b395-f7b0-4328-b60c-a6fc85e194ca\") " pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.802590 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.802488 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/1.log" May 26 10:52:19.810008 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.809986 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-pwk6b_69c25770-d860-4c8c-8965-ab8bf02cd2b6/console-operator/2.log" May 26 10:52:19.838117 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.838083 2559 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:19.972064 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.972035 2559 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr"] May 26 10:52:19.974151 ip-10-0-140-253 kubenswrapper[2559]: W0526 10:52:19.974120 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1243b395_f7b0_4328_b60c_a6fc85e194ca.slice/crio-2ec3926966cdf542e94ac9b1f110a2d01270940f286e9152025515e20bcaafd0 WatchSource:0}: Error finding container 2ec3926966cdf542e94ac9b1f110a2d01270940f286e9152025515e20bcaafd0: Status 404 returned error can't find the container with id 2ec3926966cdf542e94ac9b1f110a2d01270940f286e9152025515e20bcaafd0 May 26 10:52:19.975647 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:19.975616 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 26 10:52:20.766812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:20.766767 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" event={"ID":"1243b395-f7b0-4328-b60c-a6fc85e194ca","Type":"ContainerStarted","Data":"f5f67cefa864adb4e789e7c27383a68e24838beda8df7ce51390d23361fc4d6f"} May 26 10:52:20.766812 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:20.766808 2559 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" event={"ID":"1243b395-f7b0-4328-b60c-a6fc85e194ca","Type":"ContainerStarted","Data":"2ec3926966cdf542e94ac9b1f110a2d01270940f286e9152025515e20bcaafd0"} May 26 10:52:20.767236 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:20.766828 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:20.783679 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:20.783605 2559 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" podStartSLOduration=1.7835863299999999 podStartE2EDuration="1.78358633s" podCreationTimestamp="2026-05-26 10:52:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 10:52:20.781226527 +0000 UTC m=+2536.177335663" watchObservedRunningTime="2026-05-26 10:52:20.78358633 +0000 UTC m=+2536.179695473" May 26 10:52:20.854220 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:20.854189 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-h7s5c_d352782c-b47e-4243-87e4-d7112b6c7172/volume-data-source-validator/0.log" May 26 10:52:21.630838 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:21.630798 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fbg7z_60d9ffbe-34f5-49be-bf7c-3919d8e6bc26/dns/0.log" May 26 10:52:21.650295 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:21.650270 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fbg7z_60d9ffbe-34f5-49be-bf7c-3919d8e6bc26/kube-rbac-proxy/0.log" May 26 10:52:21.718184 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:21.718157 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8wrj_3b5a6113-a99d-4f42-91b0-afac5f987e52/dns-node-resolver/0.log" May 26 10:52:22.282747 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:22.282705 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ct4xd_aa0484c9-1cdb-4bab-8408-1804b7965bb1/node-ca/0.log" May 26 10:52:23.300747 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:23.300704 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-mqcx5_287c278e-9902-4c9c-a3de-70d25f08fcf1/discovery/0.log" May 26 10:52:23.326549 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:23.326513 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-546bd7d749-g5v86_81ce0b14-b67e-4182-9e22-66fa630a16f0/kube-auth-proxy/0.log" May 26 10:52:23.488709 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:23.488681 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-575fd68fbd-x59tq_0f4289b5-0a91-47bf-94a9-596d42576100/router/0.log" May 26 10:52:24.037271 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.037241 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gvs8f_7acae325-51d9-4f45-8669-46262f25ccee/serve-healthcheck-canary/0.log" May 26 10:52:24.581364 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.581337 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-wxcx9_2a1fd620-8f7d-4adf-82da-7cb70a76dd64/insights-operator/0.log" May 26 10:52:24.582015 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.581993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-wxcx9_2a1fd620-8f7d-4adf-82da-7cb70a76dd64/insights-operator/1.log" May 26 10:52:24.601018 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.600993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdj8_ec56f004-0515-4171-a6d0-dbd002755810/kube-rbac-proxy/0.log" May 26 10:52:24.621535 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.621486 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdj8_ec56f004-0515-4171-a6d0-dbd002755810/exporter/0.log" May 26 10:52:24.643157 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:24.643126 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7vdj8_ec56f004-0515-4171-a6d0-dbd002755810/extractor/0.log" May 26 10:52:26.672452 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:26.672423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7xwcb_50f4f3df-0fd0-465f-9300-d7b4e3fe1ef3/manager/0.log" May 26 10:52:26.780521 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:26.780496 2559 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7hzkl/perf-node-gather-daemonset-vkxbr" May 26 10:52:26.848625 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:26.848581 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9jrd5_592cb579-e2ea-449d-8f8a-f0a45e2858a1/manager/1.log" May 26 10:52:26.870697 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:26.870667 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-9jrd5_592cb579-e2ea-449d-8f8a-f0a45e2858a1/manager/2.log" May 26 10:52:26.948832 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:26.948753 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c66b4d846-tr9ct_e0e8f5e5-f9b3-4032-9602-9e8c1270d223/manager/0.log" May 26 10:52:27.003036 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:27.003003 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-9sgpq_a69557c0-84d5-4b92-a2a8-cce3482686f5/postgres/0.log" May 26 10:52:33.192525 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:33.192477 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-74z5c_3f4534f1-7047-4944-b6f6-ecea9352ed74/kube-storage-version-migrator-operator/1.log" May 26 10:52:33.194234 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:33.194206 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-74z5c_3f4534f1-7047-4944-b6f6-ecea9352ed74/kube-storage-version-migrator-operator/0.log" May 26 10:52:34.407416 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.407363 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/kube-multus-additional-cni-plugins/0.log" May 26 10:52:34.427591 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.427565 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/egress-router-binary-copy/0.log" May 26 10:52:34.447464 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.447423 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/cni-plugins/0.log" May 26 10:52:34.468006 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.467973 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/bond-cni-plugin/0.log" May 26 10:52:34.487772 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.487744 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/routeoverride-cni/0.log" May 26 10:52:34.507285 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.507253 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/whereabouts-cni-bincopy/0.log" May 26 10:52:34.528616 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.528583 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-n5lkq_b389785e-acca-4d76-b4c1-4178957e3f6a/whereabouts-cni/0.log" May 26 10:52:34.724949 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.724863 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kzcsg_e7a2478e-7b70-41ab-8a81-798d9a877cb6/kube-multus/0.log" May 26 10:52:34.773801 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.773774 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4rt42_911fd9ce-a15b-4db5-b7a1-200ce0e77759/network-metrics-daemon/0.log" May 26 10:52:34.794248 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:34.794222 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4rt42_911fd9ce-a15b-4db5-b7a1-200ce0e77759/kube-rbac-proxy/0.log" May 26 10:52:35.994158 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:35.994127 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-controller/0.log" May 26 10:52:36.009227 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.009193 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/0.log" May 26 10:52:36.031332 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.031302 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/ovn-acl-logging/1.log" May 26 10:52:36.052267 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.052233 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/kube-rbac-proxy-node/0.log" May 26 10:52:36.073106 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.073069 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/kube-rbac-proxy-ovn-metrics/0.log" May 26 10:52:36.089503 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.089467 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/northd/0.log" May 26 10:52:36.111881 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.111851 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/nbdb/0.log" May 26 10:52:36.134468 ip-10-0-140-253 kubenswrapper[2559]: I0526 10:52:36.134429 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h9rf2_324a060c-0fe6-4745-8d73-abfdf00ca20d/sbdb/0.log"