May 27 21:27:57.841970 ip-10-0-138-159 systemd[1]: Starting Kubernetes Kubelet...
May 27 21:27:58.337068 ip-10-0-138-159 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 21:27:58.337068 ip-10-0-138-159 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 27 21:27:58.337068 ip-10-0-138-159 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 21:27:58.337068 ip-10-0-138-159 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 27 21:27:58.337681 ip-10-0-138-159 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 27 21:27:58.340717 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.340631    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 27 21:27:58.346725 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346707    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 21:27:58.346725 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346724    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 21:27:58.346725 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346729    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346733    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346737    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346742    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346747    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346751    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346755    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346759    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346764    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346768    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346772    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346776    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346779    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346783    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346787    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346791    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346802    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346806    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346810    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346814    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 21:27:58.346914 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346817    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346822    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346826    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346830    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346835    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346839    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346844    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346848    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346853    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346857    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346862    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346866    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346870    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346874    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346879    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346883    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346897    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346904    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346909    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 21:27:58.347726 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346913    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346917    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346922    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346926    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346930    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346934    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346937    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346942    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346946    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346950    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346953    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346957    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346962    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346966    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346970    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346976    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346980    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346989    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.346995    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347000    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 21:27:58.348444 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347004    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347009    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347013    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347018    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347022    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347027    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347032    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347036    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347041    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347045    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347049    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347053    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347057    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347061    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347066    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347070    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347074    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347078    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347082    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347086    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 21:27:58.348947 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347090    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347095    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347099    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347103    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347107    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347737    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347746    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347751    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347758    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347765    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347770    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347774    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347778    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347782    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347786    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347791    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347796    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347801    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347806    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 21:27:58.349431 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347810    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347815    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347819    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347823    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347827    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347831    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347835    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347840    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347844    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347848    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347853    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347857    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347862    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347866    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347870    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347874    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347879    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347883    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347887    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347891    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 21:27:58.350121 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347895    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347900    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347906    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347911    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347915    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347920    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347926    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347932    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347937    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347942    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347946    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347951    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347955    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347960    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347964    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347968    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347972    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347976    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347980    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347984    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 21:27:58.351050 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347989    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347992    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.347996    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348000    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348004    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348009    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348013    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348017    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348021    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348025    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348029    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348033    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348037    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348042    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348046    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348051    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348055    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348059    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348065    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348069    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 21:27:58.351570 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348077    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348081    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348086    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348090    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348095    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348099    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348103    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348107    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348111    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348115    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348119    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.348123    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349727    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349744    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349756    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349763    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349770    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349775    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349782    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349788    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349793    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 27 21:27:58.352090 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349798    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349804    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349810    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349815    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349821    2558 flags.go:64] FLAG: --cgroup-root=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349825    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349830    2558 flags.go:64] FLAG: --client-ca-file=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349835    2558 flags.go:64] FLAG: --cloud-config=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349840    2558 flags.go:64] FLAG: --cloud-provider="external"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349845    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349851    2558 flags.go:64] FLAG: --cluster-domain=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349856    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349861    2558 flags.go:64] FLAG: --config-dir=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349866    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349872    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349888    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349894    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349899    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349904    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349909    2558 flags.go:64] FLAG: --contention-profiling="false"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349914    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349918    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349923    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349928    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349934    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 27 21:27:58.352715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349939    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349944    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349948    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349953    2558 flags.go:64] FLAG: --enable-server="true"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349957    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349966    2558 flags.go:64] FLAG: --event-burst="100"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349971    2558 flags.go:64] FLAG: --event-qps="50"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349976    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349981    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349986    2558 flags.go:64] FLAG: --eviction-hard=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349992    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.349997    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350001    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350006    2558 flags.go:64] FLAG: --eviction-soft=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350012    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350016    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350021    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350025    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350030    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350035    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350040    2558 flags.go:64] FLAG: --feature-gates=""
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350046    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350051    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350056    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350062    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350067    2558 flags.go:64] FLAG: --healthz-port="10248"
May 27 21:27:58.353524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350072    2558 flags.go:64] FLAG: --help="false"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350076    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-159.ec2.internal"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350081    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350086    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350091    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350096    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350102    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350107    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350111    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350116    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350120    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350125    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350129    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350134    2558 flags.go:64] FLAG: --kube-reserved=""
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350138    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350142    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350147    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350152    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350157    2558 flags.go:64] FLAG: --lock-file=""
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350161    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350166    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350171    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350180    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 27 21:27:58.354187 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350185    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350190    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350195    2558 flags.go:64] FLAG: --logging-format="text"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350202    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350208    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350212    2558 flags.go:64] FLAG: --manifest-url=""
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350217    2558 flags.go:64] FLAG: --manifest-url-header=""
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350224    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350229    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350236    2558 flags.go:64] FLAG: --max-pods="110"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350241    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350246    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350251    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350255    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350260    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350264    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350269    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350281    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350285    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350290    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350295    2558 flags.go:64] FLAG: --pod-cidr=""
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350299    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350308    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350312    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 27 21:27:58.354813 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350317    2558 flags.go:64] FLAG: --pods-per-core="0"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350322    2558 flags.go:64] FLAG: --port="10250"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350326    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350331    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b226a6076c2f9ab8"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350336    2558 flags.go:64] FLAG: --qos-reserved=""
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350341    2558 flags.go:64] FLAG: --read-only-port="10255"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350345    2558 flags.go:64] FLAG: --register-node="true"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350350    2558 flags.go:64] FLAG: --register-schedulable="true"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350354    2558 flags.go:64] FLAG: --register-with-taints=""
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350360    2558 flags.go:64] FLAG: --registry-burst="10"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350364    2558 flags.go:64] FLAG: --registry-qps="5"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350371    2558 flags.go:64] FLAG: --reserved-cpus=""
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350376    2558 flags.go:64] FLAG: --reserved-memory=""
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350382    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350387    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350392    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350396    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350402    2558 flags.go:64] FLAG: --runonce="false"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350406    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350411    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350416    2558 flags.go:64] FLAG: --seccomp-default="false"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350421    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350426    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350430    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350436    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350441    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 27 21:27:58.355428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350445    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350450    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350455    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350460    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350465    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350470    2558 flags.go:64] FLAG: --system-cgroups=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350474    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350482    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350487    2558 flags.go:64] FLAG: --tls-cert-file=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350492    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350498    2558 flags.go:64] FLAG: --tls-min-version=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350503    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350511    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350516    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350521    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350527    2558 flags.go:64] FLAG: --v="2"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350534    2558 flags.go:64] FLAG: --version="false"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350545    2558 flags.go:64] FLAG: --vmodule=""
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350552    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.350558    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350731    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350739    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350744    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350748    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 21:27:58.356060 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350752    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350757    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350761    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350765    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350770    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350773    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350778    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350782    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350786    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350790    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350793    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350797    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350801    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350805    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350810    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350813    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350817    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350821    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350825    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350829    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 21:27:58.356638 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350835    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350839    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350843    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350849    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350854    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350863    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350867    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350872    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350876    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350880    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350884    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350888    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350892    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350897    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350902    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350906    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350911    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350915    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350919    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350923    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 21:27:58.357180 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350927    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350932    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350936    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350942    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350948    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350954    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350960    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350964    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350969    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350974    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350978    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350983    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350989    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350994    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.350999    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351003    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351007    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351012    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351017    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 21:27:58.357681 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351021    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351025    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351029    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351033    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351038    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351042    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351046    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351051    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351055    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351059    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351063    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351067    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351071    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351075    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351079    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351083    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351087    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351091    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351096    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 21:27:58.358221 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351100    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 21:27:58.358700 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351104    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 21:27:58.358700 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351109    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 21:27:58.358700 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.351113    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 21:27:58.358700 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.352079    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 21:27:58.361136 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.361117    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 27 21:27:58.361168 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.361138    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 27 21:27:58.363201 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363182    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 21:27:58.363201 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363202    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363211    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363215    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363219    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363223    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363227    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363231    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363236    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363242    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363248    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363252    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363257    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363261    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363264    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363268    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363272    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363276    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363280    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363284    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 21:27:58.363339 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363288    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363292    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363296    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363301    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363305    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363308    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363312    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363316    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363320    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363326    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363331    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363336    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363340    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363344    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363348    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363352    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363357    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363360    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363365    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363369    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 21:27:58.364306 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363373    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363377    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363381    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363385    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363389    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363393    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363397    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363401    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363405    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363410    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363414    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363419    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363424    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363428    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363433    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363437    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363441    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363445    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363449    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 21:27:58.364818 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363453    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363458    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363462    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363466    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363470    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363474    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363478    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363483    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363487    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363491    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363494    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363499    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363503    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363507    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363511    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363516    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363520    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363524    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363528    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363534    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 21:27:58.365349 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363539    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363543    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363547    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363551    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363556    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363560    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363564    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.363572    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363760    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363770    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363775    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363780    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363785    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363789    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363793    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363798    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 27 21:27:58.365858 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363802    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363806    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363809    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363813    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363817    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363821    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363826    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363830    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363834    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363838    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363842    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363847    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363851    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363855    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363859    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363863    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363871    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363878    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363882    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363886    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 27 21:27:58.366465 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363890    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363894    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363898    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363902    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363907    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363911    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363915    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363920    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363924    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363928    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363932    2558 feature_gate.go:328] unrecognized feature gate: Example
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363936    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363940    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363944    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363949    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363953    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363957    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363961    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363965    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363969    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 27 21:27:58.367307 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363973    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363979    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363985    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363990    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363994    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.363998    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364002    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364007    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364011    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364017    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364022    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364025    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364030    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364034    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364038    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364042    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364046    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364050    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364054    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 27 21:27:58.367874 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364058    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364062    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364066    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364070    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364074    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364079    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364083    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364087    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364091    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364095    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364099    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364103    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364108    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364111    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364116    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364120    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364124    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364128    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 27 21:27:58.368460 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:58.364132    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 27 21:27:58.369029 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.364140    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 27 21:27:58.369029 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.365052    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 27 21:27:58.369029 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.368209    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 27 21:27:58.369432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.369418    2558 server.go:1019] "Starting client certificate rotation"
May 27 21:27:58.369539 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.369522    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 21:27:58.369578 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.369563    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 27 21:27:58.397631 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.397595    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 21:27:58.399465 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.399451    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 27 21:27:58.420158 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.420141    2558 log.go:25] "Validated CRI v1 runtime API"
May 27 21:27:58.426335 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.426315    2558 log.go:25] "Validated CRI v1 image API"
May 27 21:27:58.428688 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.428660    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 27 21:27:58.434188 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.434158    2558 fs.go:135] Filesystem UUIDs: map[21aa7406-0348-4ab2-8eee-d5ef453490d9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d35a2a38-3f68-41f3-a489-a3253d1e3418:/dev/nvme0n1p4]
May 27 21:27:58.434244 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.434188    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 27 21:27:58.439380 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.439361    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 21:27:58.439980 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.439873    2558 manager.go:217] Machine: {Timestamp:2026-05-27 21:27:58.439336556 +0000 UTC m=+0.467155756 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105955 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f236a22199fbcd04365608737616b SystemUUID:ec2f236a-2219-9fbc-d043-65608737616b BootID:0fd1488e-2a15-4e66-99d8-902cc18e27f7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:12:f6:06:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:12:f6:06:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:f5:ec:9e:a1:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 27 21:27:58.439980 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.439978    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 27 21:27:58.440087 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.440075    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 27 21:27:58.443107 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.443085    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 27 21:27:58.443236 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.443109    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-159.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 27 21:27:58.443305 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.443245    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 27 21:27:58.443305 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.443254    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 27 21:27:58.443305 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.443261    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 21:27:58.444190 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.444179    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 27 21:27:58.446989 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.446977    2558 state_mem.go:36] "Initialized new in-memory state store"
May 27 21:27:58.447230 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.447221    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 27 21:27:58.450010 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.450000    2558 kubelet.go:491] "Attempting to sync node with API server"
May 27 21:27:58.450053 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.450013    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 27 21:27:58.450053 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.450025    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 27 21:27:58.450053 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.450033    2558 kubelet.go:397] "Adding apiserver pod source"
May 27 21:27:58.450053 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.450041    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 27 21:27:58.451240 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.451227    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 21:27:58.451305 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.451245    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 27 21:27:58.456437 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.456423    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 27 21:27:58.458856 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.458841    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 27 21:27:58.459873 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459856    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 27 21:27:58.459931 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459882    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 27 21:27:58.459931 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459898    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 27 21:27:58.459931 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459910    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 27 21:27:58.459931 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459922    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 27 21:27:58.459931 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459932    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 27 21:27:58.460083 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459941    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 27 21:27:58.460083 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459951    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 27 21:27:58.460083 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459963    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 27 21:27:58.460083 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459971    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 27 21:27:58.460083 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.459994    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 27 21:27:58.460264 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.460211    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 27 21:27:58.461243 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.461230    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 27 21:27:58.461243 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.461244    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 27 21:27:58.462074 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.462047    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 27 21:27:58.462164 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.462140    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 27 21:27:58.464338 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.464324    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 27 21:27:58.464402 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.464363    2558 server.go:1295] "Started kubelet"
May 27 21:27:58.464470 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.464444    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 27 21:27:58.464523 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.464447    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 27 21:27:58.464523 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.464511    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 27 21:27:58.465099 ip-10-0-138-159 systemd[1]: Started Kubernetes Kubelet.
May 27 21:27:58.466120 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.465987    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 27 21:27:58.467740 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.467723    2558 server.go:317] "Adding debug handlers to kubelet server"
May 27 21:27:58.475366 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.475286    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 27 21:27:58.475507 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.475493    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 27 21:27:58.475651 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.475640    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 27 21:27:58.475651 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.475651    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 27 21:27:58.476740 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.476704    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 27 21:27:58.476831 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.476756    2558 reconstruct.go:97] "Volume reconstruction finished"
May 27 21:27:58.476831 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.476776    2558 reconciler.go:26] "Reconciler: start to sync state"
May 27 21:27:58.476831 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.476734    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.477071 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477058    2558 factory.go:153] Registering CRI-O factory
May 27 21:27:58.477128 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477118    2558 factory.go:223] Registration of the crio container factory successfully
May 27 21:27:58.477216 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477203    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 27 21:27:58.477291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477216    2558 factory.go:55] Registering systemd factory
May 27 21:27:58.477291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477224    2558 factory.go:223] Registration of the systemd container factory successfully
May 27 21:27:58.477291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477243    2558 factory.go:103] Registering Raw factory
May 27 21:27:58.477291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.477258    2558 manager.go:1196] Started watching for new ooms in manager
May 27 21:27:58.478204 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.478186    2558 manager.go:319] Starting recovery of all containers
May 27 21:27:58.480594 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.480565    2558 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 27 21:27:58.483943 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.483751    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 27 21:27:58.484439 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.484417    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhp4t"
May 27 21:27:58.484654 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.480638    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-159.ec2.internal.18b389559872635b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-159.ec2.internal,UID:ip-10-0-138-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-159.ec2.internal,},FirstTimestamp:2026-05-27 21:27:58.464336731 +0000 UTC m=+0.492155930,LastTimestamp:2026-05-27 21:27:58.464336731 +0000 UTC m=+0.492155930,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-159.ec2.internal,}"
May 27 21:27:58.484756 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.484728    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-159.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 27 21:27:58.485084 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.485065    2558 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-159.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 27 21:27:58.492173 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.492156    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zhp4t"
May 27 21:27:58.492243 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.492227    2558 manager.go:324] Recovery completed
May 27 21:27:58.496023 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.496012    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.498985 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.498972    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.499047 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.499002    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.499047 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.499015    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.499453 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.499437    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 27 21:27:58.499453 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.499453    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 27 21:27:58.499562 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.499470    2558 state_mem.go:36] "Initialized new in-memory state store"
May 27 21:27:58.500817 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.500747    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-159.ec2.internal.18b389559a83193f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-159.ec2.internal,UID:ip-10-0-138-159.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-159.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-159.ec2.internal,},FirstTimestamp:2026-05-27 21:27:58.498986303 +0000 UTC m=+0.526805505,LastTimestamp:2026-05-27 21:27:58.498986303 +0000 UTC m=+0.526805505,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-159.ec2.internal,}"
May 27 21:27:58.503277 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.503265    2558 policy_none.go:49] "None policy: Start"
May 27 21:27:58.503336 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.503281    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 27 21:27:58.503336 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.503291    2558 state_mem.go:35] "Initializing new in-memory state store"
May 27 21:27:58.545153 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545139    2558 manager.go:341] "Starting Device Plugin manager"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.545198    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545208    2558 server.go:85] "Starting device plugin registration server"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545486    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545497    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545576    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545676    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.545685    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.546198    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.546235    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.556483    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.557757    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.557775    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.557789    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.557795    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.557832    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 27 21:27:58.569721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.560346    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:27:58.646028 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.645986    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.646872 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.646854    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.646966 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.646890    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.646966 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.646903    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.646966 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.646932    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-159.ec2.internal"
May 27 21:27:58.656097 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.656081    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-159.ec2.internal"
May 27 21:27:58.656172 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.656103    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-159.ec2.internal\": node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.658832 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.658819    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"]
May 27 21:27:58.658897 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.658887    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.661735 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.661716    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.661832 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.661747    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.661832 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.661760    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.664373 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.664359    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.664533 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.664519    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.664575 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.664549    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.665044 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665030    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.665109 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665057    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.665109 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665033    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.665109 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665071    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.665109 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665090    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.665109 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.665103    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.667502 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.667486    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.667583 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.667515    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 27 21:27:58.668602 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.668587    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientMemory"
May 27 21:27:58.668711 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.668628    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasNoDiskPressure"
May 27 21:27:58.668711 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.668643    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeHasSufficientPID"
May 27 21:27:58.670955 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.670938    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.678283 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.678267    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.678353 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.678290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.678353 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.678311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39b57b60eeeca70eb09bd98253b12281-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"39b57b60eeeca70eb09bd98253b12281\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.694178 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.694157    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-159.ec2.internal\" not found" node="ip-10-0-138-159.ec2.internal"
May 27 21:27:58.698421 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.698404    2558 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-159.ec2.internal\" not found" node="ip-10-0-138-159.ec2.internal"
May 27 21:27:58.771858 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.771838    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.778546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778528    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.778650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778559    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.778650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778577    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39b57b60eeeca70eb09bd98253b12281-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"39b57b60eeeca70eb09bd98253b12281\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.778650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778604    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.778650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778628    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ff80c328d06fa711afd00a4156e7f026-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal\" (UID: \"ff80c328d06fa711afd00a4156e7f026\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.778781 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.778663    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39b57b60eeeca70eb09bd98253b12281-config\") pod \"kube-apiserver-proxy-ip-10-0-138-159.ec2.internal\" (UID: \"39b57b60eeeca70eb09bd98253b12281\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:27:58.872883 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.872829    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.973534 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:58.973501    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:58.999068 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:58.999038    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:27:59.002788 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.002773    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:27:59.074355 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.074328    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.174968 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.174904    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.275411 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.275380    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.315213 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.315184    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:27:59.369830 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.369803    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 27 21:27:59.370459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.369930    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 21:27:59.370459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.369966    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 27 21:27:59.376065 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.376041    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.475996 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.475935    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 27 21:27:59.476150 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.476112    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.494132 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.494088    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-26 21:22:58 +0000 UTC" deadline="2028-02-23 14:57:35.521054262 +0000 UTC"
May 27 21:27:59.494132 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.494115    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15281h29m36.026943256s"
May 27 21:27:59.496291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.496274    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 27 21:27:59.520324 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.520305    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ts2zm"
May 27 21:27:59.526883 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.526866    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ts2zm"
May 27 21:27:59.561688 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:59.561656    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff80c328d06fa711afd00a4156e7f026.slice/crio-5a5befdb3d8c1aca162c5b1bb66447fad874b304baa7bdac0d2144d7bbe7328f WatchSource:0}: Error finding container 5a5befdb3d8c1aca162c5b1bb66447fad874b304baa7bdac0d2144d7bbe7328f: Status 404 returned error can't find the container with id 5a5befdb3d8c1aca162c5b1bb66447fad874b304baa7bdac0d2144d7bbe7328f
May 27 21:27:59.561915 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:27:59.561894    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b57b60eeeca70eb09bd98253b12281.slice/crio-ee2995d2ace0c4b5e72a72c51046afd3cc3f374e98199cb865ae727bc9ec8014 WatchSource:0}: Error finding container ee2995d2ace0c4b5e72a72c51046afd3cc3f374e98199cb865ae727bc9ec8014: Status 404 returned error can't find the container with id ee2995d2ace0c4b5e72a72c51046afd3cc3f374e98199cb865ae727bc9ec8014
May 27 21:27:59.565467 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.565441    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 21:27:59.577038 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.577013    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.609418 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.609394    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:27:59.677165 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.677128    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.777490 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.777425    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.877901 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.877863    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.978602 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:27:59.978572    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-159.ec2.internal\" not found"
May 27 21:27:59.996047 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:27:59.996027    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:28:00.077178 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.077101    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal"
May 27 21:28:00.090054 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.090000    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 21:28:00.091308 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.091284    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal"
May 27 21:28:00.101794 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.101752    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 27 21:28:00.451262 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.451182    2558 apiserver.go:52] "Watching apiserver"
May 27 21:28:00.459932 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.459907    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 27 21:28:00.460370 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.460337    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal","openshift-dns/node-resolver-cl522","openshift-image-registry/node-ca-cd4wq","openshift-multus/multus-4jggt","openshift-multus/network-metrics-daemon-2vqzh","openshift-network-diagnostics/network-check-target-rwkkv","openshift-network-operator/iptables-alerter-c8g5m","kube-system/konnectivity-agent-f42f9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p","openshift-cluster-node-tuning-operator/tuned-25xrt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal","openshift-multus/multus-additional-cni-plugins-fv45z","openshift-ovn-kubernetes/ovnkube-node-vv2w4"]
May 27 21:28:00.464974 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.464953    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.465234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.465113    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.467163 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.467142    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.468840 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468522    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 27 21:28:00.468840 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468532    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 27 21:28:00.468840 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468570    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rbkkl\""
May 27 21:28:00.468840 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468570    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-88j95\""
May 27 21:28:00.468840 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468841    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 27 21:28:00.469179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.468928    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 27 21:28:00.469179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.469026    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 27 21:28:00.469750 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.469556    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 27 21:28:00.469750 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.469561    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 27 21:28:00.469750 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.469642    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-khf67\""
May 27 21:28:00.469750 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.469649    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 27 21:28:00.471798 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.471147    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jggt"
May 27 21:28:00.471798 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.471233    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.471798 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.471298    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:00.473639 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.473283    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 27 21:28:00.473639 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.473467    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 27 21:28:00.474266 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.474106    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 27 21:28:00.474266 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.474135    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4frb9\""
May 27 21:28:00.474266 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.474180    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 27 21:28:00.477359 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.476963    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:00.477359 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.477074    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:00.480700 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.480681    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.480876 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.480854    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.482861 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.482720    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 27 21:28:00.483235 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483051    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 27 21:28:00.483609 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483589    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 27 21:28:00.483711 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483682    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 27 21:28:00.483823 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4gsxg\""
May 27 21:28:00.483885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483805    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 27 21:28:00.483939 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.483884    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t752l\""
May 27 21:28:00.486007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.485988    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.486130 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486108    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.486844 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01b52d0d-16d1-46ad-8ffc-3708ff474d04-serviceca\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.486940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-multus\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.486940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-kubelet\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.486940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486915    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnq56\" (UniqueName: \"kubernetes.io/projected/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kube-api-access-xnq56\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf4e49c-cfdb-4ab2-8462-b3f90924f126-tmp-dir\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6mt\" (UniqueName: \"kubernetes.io/projected/01b52d0d-16d1-46ad-8ffc-3708ff474d04-kube-api-access-jj6mt\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.486985    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grbmv\" (UniqueName: \"kubernetes.io/projected/089c39ef-3460-472d-98e8-488986450b10-kube-api-access-grbmv\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487047    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01b52d0d-16d1-46ad-8ffc-3708ff474d04-host\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-cnibin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487100 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487092    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-hostroot\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487115    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-conf-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g64kl\" (UniqueName: \"kubernetes.io/projected/0e37582f-501f-48e0-ace0-4f5640789b07-kube-api-access-g64kl\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-etc-selinux\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-sys-fs\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487235    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acf4e49c-cfdb-4ab2-8462-b3f90924f126-hosts-file\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xldpg\" (UniqueName: \"kubernetes.io/projected/acf4e49c-cfdb-4ab2-8462-b3f90924f126-kube-api-access-xldpg\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-multus-daemon-config\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487305    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-multus-certs\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487500 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487448    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-etc-kubernetes\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-device-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487554    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-os-release\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495058c8-d1d1-4db5-89c1-8e457294f2cc-agent-certs\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495058c8-d1d1-4db5-89c1-8e457294f2cc-konnectivity-ca\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-host-slash\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-bin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487827    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-socket-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-registration-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-iptables-alerter-script\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-socket-dir-parent\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.487988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-k8s-cni-cncf-io\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.487998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxvlf\" (UniqueName: \"kubernetes.io/projected/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-kube-api-access-pxvlf\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488042    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-system-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488070    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488112    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-cni-binary-copy\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-netns\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488258    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488285    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-c4hqf\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488380    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s2l9m\""
May 27 21:28:00.488516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.488461    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.490593 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.490567    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 27 21:28:00.490701 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.490598    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 27 21:28:00.490758 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.490725    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 27 21:28:00.490872 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.490855    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 27 21:28:00.491061 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.490935    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jtb6t\""
May 27 21:28:00.491061 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.491005    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 27 21:28:00.491217 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.491171    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 27 21:28:00.518201 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.518043    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:28:00.527583 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.527554    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:22:59 +0000 UTC" deadline="2028-01-26 10:14:34.454089822 +0000 UTC"
May 27 21:28:00.527699 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.527585    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14604h46m33.926509815s"
May 27 21:28:00.565941 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.565875    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"ff80c328d06fa711afd00a4156e7f026","Type":"ContainerStarted","Data":"5a5befdb3d8c1aca162c5b1bb66447fad874b304baa7bdac0d2144d7bbe7328f"}
May 27 21:28:00.567177 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.567146    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" event={"ID":"39b57b60eeeca70eb09bd98253b12281","Type":"ContainerStarted","Data":"ee2995d2ace0c4b5e72a72c51046afd3cc3f374e98199cb865ae727bc9ec8014"}
May 27 21:28:00.578309 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.578285    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 27 21:28:00.589032 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.588994    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-registration-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.589135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.589135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-systemd\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.589135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589080    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-socket-dir-parent\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.589135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589103    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-k8s-cni-cncf-io\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.589135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589129    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589154    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589172    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pxvlf\" (UniqueName: \"kubernetes.io/projected/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-kube-api-access-pxvlf\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589189    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-cni-binary-copy\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589204    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-systemd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-var-lib-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589234    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-kubelet\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-node-log\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-log-socket\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589291    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-sys\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589308    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf4e49c-cfdb-4ab2-8462-b3f90924f126-tmp-dir\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.589345 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589325    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvq5\" (UniqueName: \"kubernetes.io/projected/85d1deaa-c52f-4620-8b3e-d880165f7fdf-kube-api-access-mfvq5\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589374    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-var-lib-kubelet\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589394    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnkq2\" (UniqueName: \"kubernetes.io/projected/fc181868-c97c-456c-9e4e-430027a5fd67-kube-api-access-mnkq2\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589409    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-hostroot\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589425    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-conf-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589446    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g64kl\" (UniqueName: \"kubernetes.io/projected/0e37582f-501f-48e0-ace0-4f5640789b07-kube-api-access-g64kl\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-kubelet\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589489    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-multus-daemon-config\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-system-cni-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589566    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-conf\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589584    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-os-release\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589599    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495058c8-d1d1-4db5-89c1-8e457294f2cc-konnectivity-ca\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-cnibin\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589658    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysconfig\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589746    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-registration-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589769    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-socket-dir-parent\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.590759 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589844    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-os-release\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.589899    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-k8s-cni-cncf-io\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590342    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-multus-daemon-config\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590341    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/495058c8-d1d1-4db5-89c1-8e457294f2cc-konnectivity-ca\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-kubernetes\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590567    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/089c39ef-3460-472d-98e8-488986450b10-cni-binary-copy\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590578    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-hostroot\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590594    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-kubelet\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590604    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-conf-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.590688    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.590769    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:01.090737149 +0000 UTC m=+3.118556356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590793    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-host-slash\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590826    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-slash\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590876    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590884    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-host-slash\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590899    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-script-lib\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.591561 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-host\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590929    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf4e49c-cfdb-4ab2-8462-b3f90924f126-tmp-dir\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590949    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-iptables-alerter-script\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.590978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-systemd-units\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591014    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-netns\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovn-node-metrics-cert\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591149    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591199    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-lib-modules\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591230    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-system-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591257    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-netns\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591291    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-iptables-alerter-script\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591327    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-system-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591331    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01b52d0d-16d1-46ad-8ffc-3708ff474d04-serviceca\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591359    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-netns\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591367    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-multus\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591411    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-multus\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591422    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnq56\" (UniqueName: \"kubernetes.io/projected/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kube-api-access-xnq56\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.592246 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k69vz\" (UniqueName: \"kubernetes.io/projected/02e3acb1-bd19-4356-ac08-690841ffbf76-kube-api-access-k69vz\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591489    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-ovn\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-env-overrides\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591540    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6mt\" (UniqueName: \"kubernetes.io/projected/01b52d0d-16d1-46ad-8ffc-3708ff474d04-kube-api-access-jj6mt\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591565    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-grbmv\" (UniqueName: \"kubernetes.io/projected/089c39ef-3460-472d-98e8-488986450b10-kube-api-access-grbmv\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591589    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591606    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01b52d0d-16d1-46ad-8ffc-3708ff474d04-serviceca\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591633    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-config\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-etc-tuned\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591779    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01b52d0d-16d1-46ad-8ffc-3708ff474d04-host\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591812    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-cnibin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591838    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591861    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-etc-selinux\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591870    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01b52d0d-16d1-46ad-8ffc-3708ff474d04-host\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591891    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-sys-fs\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591915    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-cnibin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591918    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.593074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591933    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591940    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-etc-selinux\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-bin\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.591982    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-sys-fs\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592008    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acf4e49c-cfdb-4ab2-8462-b3f90924f126-hosts-file\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592035    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xldpg\" (UniqueName: \"kubernetes.io/projected/acf4e49c-cfdb-4ab2-8462-b3f90924f126-kube-api-access-xldpg\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592110    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-multus-certs\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592113    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/acf4e49c-cfdb-4ab2-8462-b3f90924f126-hosts-file\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592129    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-etc-kubernetes\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592150    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-device-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592156    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-run-multus-certs\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-netd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592186    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-etc-kubernetes\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-modprobe-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592212    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-device-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592219    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592235    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495058c8-d1d1-4db5-89c1-8e457294f2cc-agent-certs\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.593884 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-os-release\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-run\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-tmp\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-etc-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592361    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-bin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-socket-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-socket-dir\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592548    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592576    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-host-var-lib-cni-bin\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.594574 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.592584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/089c39ef-3460-472d-98e8-488986450b10-multus-cni-dir\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.595835 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.595815    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/495058c8-d1d1-4db5-89c1-8e457294f2cc-agent-certs\") pod \"konnectivity-agent-f42f9\" (UID: \"495058c8-d1d1-4db5-89c1-8e457294f2cc\") " pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.605320 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.605290    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:00.605320 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.605319    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:00.605481 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.605334    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:00.605481 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:00.605400    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:01.105382608 +0000 UTC m=+3.133201816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:00.605593 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.605559    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxvlf\" (UniqueName: \"kubernetes.io/projected/a827e92f-a16f-4a6f-bc42-0efcf335cdfd-kube-api-access-pxvlf\") pod \"iptables-alerter-c8g5m\" (UID: \"a827e92f-a16f-4a6f-bc42-0efcf335cdfd\") " pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.606572 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.606550    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g64kl\" (UniqueName: \"kubernetes.io/projected/0e37582f-501f-48e0-ace0-4f5640789b07-kube-api-access-g64kl\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:00.607415 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.607391    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnq56\" (UniqueName: \"kubernetes.io/projected/1af1a82b-f8de-4a28-9cb7-c9f4c802bc64-kube-api-access-xnq56\") pod \"aws-ebs-csi-driver-node-chl7p\" (UID: \"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.608434 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.608413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6mt\" (UniqueName: \"kubernetes.io/projected/01b52d0d-16d1-46ad-8ffc-3708ff474d04-kube-api-access-jj6mt\") pod \"node-ca-cd4wq\" (UID: \"01b52d0d-16d1-46ad-8ffc-3708ff474d04\") " pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.609112 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.609092    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xldpg\" (UniqueName: \"kubernetes.io/projected/acf4e49c-cfdb-4ab2-8462-b3f90924f126-kube-api-access-xldpg\") pod \"node-resolver-cl522\" (UID: \"acf4e49c-cfdb-4ab2-8462-b3f90924f126\") " pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.609816 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.609769    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grbmv\" (UniqueName: \"kubernetes.io/projected/089c39ef-3460-472d-98e8-488986450b10-kube-api-access-grbmv\") pod \"multus-4jggt\" (UID: \"089c39ef-3460-472d-98e8-488986450b10\") " pod="openshift-multus/multus-4jggt"
May 27 21:28:00.693423 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693395    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-netns\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693423 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693430    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovn-node-metrics-cert\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693451    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693473    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-lib-modules\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k69vz\" (UniqueName: \"kubernetes.io/projected/02e3acb1-bd19-4356-ac08-690841ffbf76-kube-api-access-k69vz\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-netns\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693528    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-ovn\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693551    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-env-overrides\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693590    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-config\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693602    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-lib-modules\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693629    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-etc-tuned\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693675    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.693702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693704    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-bin\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693732    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-netd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693756    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-modprobe-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693784    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-os-release\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693820    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-run\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693836    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-ovn\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693605    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693842    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-tmp\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693888    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-etc-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693916    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693941    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-systemd\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693968    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693993    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694040    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694081    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-modprobe-d\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694085    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-env-overrides\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-bin\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.694298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.693994    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694134    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-etc-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694162    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-os-release\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694170    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-systemd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694196    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-var-lib-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694212    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-run\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694085    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-cni-netd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694269    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-systemd\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694229    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694307    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-systemd\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694346    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-var-lib-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694388    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-run-openvswitch\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694415    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-node-log\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694438    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-log-socket\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694460    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-sys\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694496    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvq5\" (UniqueName: \"kubernetes.io/projected/85d1deaa-c52f-4620-8b3e-d880165f7fdf-kube-api-access-mfvq5\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694519    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-var-lib-kubelet\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694546    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnkq2\" (UniqueName: \"kubernetes.io/projected/fc181868-c97c-456c-9e4e-430027a5fd67-kube-api-access-mnkq2\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694574    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-kubelet\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694601    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-system-cni-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694649    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-conf\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694676    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-cnibin\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694699    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysconfig\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694724    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-kubernetes\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694772    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694796    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-slash\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694820    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694833    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-binary-copy\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694849    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-script-lib\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694886    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-node-log\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694887    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-host\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694931    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-host\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694942    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-systemd-units\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.694972    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-kubelet\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.695953 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695011    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-log-socket\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695019    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-sys\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695054    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-systemd-units\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695108    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysconfig\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695148    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-system-cni-dir\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695267    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-sysctl-conf\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695301    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-var-lib-kubelet\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695317    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02e3acb1-bd19-4356-ac08-690841ffbf76-cnibin\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695332    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-script-lib\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695398    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc181868-c97c-456c-9e4e-430027a5fd67-etc-kubernetes\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695519    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-slash\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695564    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85d1deaa-c52f-4620-8b3e-d880165f7fdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695679    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695815    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovnkube-config\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.695851    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02e3acb1-bd19-4356-ac08-690841ffbf76-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.696328    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-etc-tuned\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.696885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.696362    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc181868-c97c-456c-9e4e-430027a5fd67-tmp\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.697753 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.697516    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/85d1deaa-c52f-4620-8b3e-d880165f7fdf-ovn-node-metrics-cert\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.707686 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.707631    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvq5\" (UniqueName: \"kubernetes.io/projected/85d1deaa-c52f-4620-8b3e-d880165f7fdf-kube-api-access-mfvq5\") pod \"ovnkube-node-vv2w4\" (UID: \"85d1deaa-c52f-4620-8b3e-d880165f7fdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:00.708007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.707986    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k69vz\" (UniqueName: \"kubernetes.io/projected/02e3acb1-bd19-4356-ac08-690841ffbf76-kube-api-access-k69vz\") pod \"multus-additional-cni-plugins-fv45z\" (UID: \"02e3acb1-bd19-4356-ac08-690841ffbf76\") " pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.708130 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.708115    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnkq2\" (UniqueName: \"kubernetes.io/projected/fc181868-c97c-456c-9e4e-430027a5fd67-kube-api-access-mnkq2\") pod \"tuned-25xrt\" (UID: \"fc181868-c97c-456c-9e4e-430027a5fd67\") " pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.779082 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.779049    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8g5m"
May 27 21:28:00.787706 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.787683    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cl522"
May 27 21:28:00.798390 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.798362    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cd4wq"
May 27 21:28:00.802967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.802944    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4jggt"
May 27 21:28:00.810581 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.810562    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:00.817194 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.817176    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p"
May 27 21:28:00.824705 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.824686    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25xrt"
May 27 21:28:00.832199 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.832175    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fv45z"
May 27 21:28:00.838786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:00.838768    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:01.052782 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.052689    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 27 21:28:01.097314 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.097274    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:01.097476 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.097396    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:01.097476 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.097465    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:02.097447042 +0000 UTC m=+4.125266247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:01.198113 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.198069    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:01.198261 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.198209    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:01.198261 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.198226    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:01.198261 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.198236    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:01.198362 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:01.198285    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:02.198272689 +0000 UTC m=+4.226091884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:01.235585 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.235431    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacf4e49c_cfdb_4ab2_8462_b3f90924f126.slice/crio-b34f5ec333b9baf49ddaa900428449622e4ecce3b3dd6547038fbea8558a9e81 WatchSource:0}: Error finding container b34f5ec333b9baf49ddaa900428449622e4ecce3b3dd6547038fbea8558a9e81: Status 404 returned error can't find the container with id b34f5ec333b9baf49ddaa900428449622e4ecce3b3dd6547038fbea8558a9e81
May 27 21:28:01.235892 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.235859    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b52d0d_16d1_46ad_8ffc_3708ff474d04.slice/crio-26886347ab62aacdc2b839d3d86d6f4602f3e2f9cf463b3c626c66dfdafd0017 WatchSource:0}: Error finding container 26886347ab62aacdc2b839d3d86d6f4602f3e2f9cf463b3c626c66dfdafd0017: Status 404 returned error can't find the container with id 26886347ab62aacdc2b839d3d86d6f4602f3e2f9cf463b3c626c66dfdafd0017
May 27 21:28:01.238736 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.238713    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc181868_c97c_456c_9e4e_430027a5fd67.slice/crio-90f13285151b7a78fa518daad24882bba95cf48e241a8d1999c7610dba50d7e7 WatchSource:0}: Error finding container 90f13285151b7a78fa518daad24882bba95cf48e241a8d1999c7610dba50d7e7: Status 404 returned error can't find the container with id 90f13285151b7a78fa518daad24882bba95cf48e241a8d1999c7610dba50d7e7
May 27 21:28:01.240938 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.240915    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af1a82b_f8de_4a28_9cb7_c9f4c802bc64.slice/crio-b5f9506bb78b8e374e80220c8b8bff564538aaa7011100353fc585300d99e545 WatchSource:0}: Error finding container b5f9506bb78b8e374e80220c8b8bff564538aaa7011100353fc585300d99e545: Status 404 returned error can't find the container with id b5f9506bb78b8e374e80220c8b8bff564538aaa7011100353fc585300d99e545
May 27 21:28:01.241274 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.241255    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda827e92f_a16f_4a6f_bc42_0efcf335cdfd.slice/crio-b68a66135be3427b9937b185a46cf0bec44341887c0df9848cd734ac948d02fe WatchSource:0}: Error finding container b68a66135be3427b9937b185a46cf0bec44341887c0df9848cd734ac948d02fe: Status 404 returned error can't find the container with id b68a66135be3427b9937b185a46cf0bec44341887c0df9848cd734ac948d02fe
May 27 21:28:01.243995 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.242130    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089c39ef_3460_472d_98e8_488986450b10.slice/crio-f11ee64352d0675ebbb1c52d5f3cbc6b057d993ecc856a12bd1b67aaf40ab96b WatchSource:0}: Error finding container f11ee64352d0675ebbb1c52d5f3cbc6b057d993ecc856a12bd1b67aaf40ab96b: Status 404 returned error can't find the container with id f11ee64352d0675ebbb1c52d5f3cbc6b057d993ecc856a12bd1b67aaf40ab96b
May 27 21:28:01.243995 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.243515    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495058c8_d1d1_4db5_89c1_8e457294f2cc.slice/crio-e4401172d20f6a074c7ad4516b7e6af0ce753c5b5f4577922448b70f86c38fd7 WatchSource:0}: Error finding container e4401172d20f6a074c7ad4516b7e6af0ce753c5b5f4577922448b70f86c38fd7: Status 404 returned error can't find the container with id e4401172d20f6a074c7ad4516b7e6af0ce753c5b5f4577922448b70f86c38fd7
May 27 21:28:01.245716 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.245269    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e3acb1_bd19_4356_ac08_690841ffbf76.slice/crio-b6c8b08360069b46a46d200b7e401076640454a2e099d8af3d47b46c60a6b3e4 WatchSource:0}: Error finding container b6c8b08360069b46a46d200b7e401076640454a2e099d8af3d47b46c60a6b3e4: Status 404 returned error can't find the container with id b6c8b08360069b46a46d200b7e401076640454a2e099d8af3d47b46c60a6b3e4
May 27 21:28:01.246894 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:01.246167    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d1deaa_c52f_4620_8b3e_d880165f7fdf.slice/crio-8e7d553715d63fdc052022f2d5b86ed1e46a32764de980105313e89cd96a78cb WatchSource:0}: Error finding container 8e7d553715d63fdc052022f2d5b86ed1e46a32764de980105313e89cd96a78cb: Status 404 returned error can't find the container with id 8e7d553715d63fdc052022f2d5b86ed1e46a32764de980105313e89cd96a78cb
May 27 21:28:01.528318 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.528279    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-26 21:22:59 +0000 UTC" deadline="2027-12-19 15:09:49.633250239 +0000 UTC"
May 27 21:28:01.528318 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.528315    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13697h41m48.10493888s"
May 27 21:28:01.573503 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.573431    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"ff80c328d06fa711afd00a4156e7f026","Type":"ContainerStarted","Data":"3a8cf446dd1888f283aaa14f0efbde72f5f692baab3ffd0506ee2144b051a8af"}
May 27 21:28:01.574645 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.574599    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"8e7d553715d63fdc052022f2d5b86ed1e46a32764de980105313e89cd96a78cb"}
May 27 21:28:01.575667 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.575644    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerStarted","Data":"b6c8b08360069b46a46d200b7e401076640454a2e099d8af3d47b46c60a6b3e4"}
May 27 21:28:01.576634 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.576586    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f42f9" event={"ID":"495058c8-d1d1-4db5-89c1-8e457294f2cc","Type":"ContainerStarted","Data":"e4401172d20f6a074c7ad4516b7e6af0ce753c5b5f4577922448b70f86c38fd7"}
May 27 21:28:01.577474 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.577455    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8g5m" event={"ID":"a827e92f-a16f-4a6f-bc42-0efcf335cdfd","Type":"ContainerStarted","Data":"b68a66135be3427b9937b185a46cf0bec44341887c0df9848cd734ac948d02fe"}
May 27 21:28:01.578294 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.578273    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25xrt" event={"ID":"fc181868-c97c-456c-9e4e-430027a5fd67","Type":"ContainerStarted","Data":"90f13285151b7a78fa518daad24882bba95cf48e241a8d1999c7610dba50d7e7"}
May 27 21:28:01.579198 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.579175    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cd4wq" event={"ID":"01b52d0d-16d1-46ad-8ffc-3708ff474d04","Type":"ContainerStarted","Data":"26886347ab62aacdc2b839d3d86d6f4602f3e2f9cf463b3c626c66dfdafd0017"}
May 27 21:28:01.580048 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.580030    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p" event={"ID":"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64","Type":"ContainerStarted","Data":"b5f9506bb78b8e374e80220c8b8bff564538aaa7011100353fc585300d99e545"}
May 27 21:28:01.581011 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.580992    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" event={"ID":"39b57b60eeeca70eb09bd98253b12281","Type":"ContainerStarted","Data":"95acc0057e944434c3e23c46885beeb3afc86dd81da7edbb32b22b4bf1185319"}
May 27 21:28:01.581830 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.581811    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jggt" event={"ID":"089c39ef-3460-472d-98e8-488986450b10","Type":"ContainerStarted","Data":"f11ee64352d0675ebbb1c52d5f3cbc6b057d993ecc856a12bd1b67aaf40ab96b"}
May 27 21:28:01.583347 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.583331    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cl522" event={"ID":"acf4e49c-cfdb-4ab2-8462-b3f90924f126","Type":"ContainerStarted","Data":"b34f5ec333b9baf49ddaa900428449622e4ecce3b3dd6547038fbea8558a9e81"}
May 27 21:28:01.601448 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:01.601405    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-159.ec2.internal" podStartSLOduration=1.6013862429999999 podStartE2EDuration="1.601386243s" podCreationTimestamp="2026-05-27 21:28:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:28:01.601044844 +0000 UTC m=+3.628864054" watchObservedRunningTime="2026-05-27 21:28:01.601386243 +0000 UTC m=+3.629205452"
May 27 21:28:02.105983 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.105942    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:02.106186 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.106159    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:02.106250 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.106224    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:04.106205635 +0000 UTC m=+6.134024827 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:02.207993 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.207322    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:02.207993 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.207501    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:02.207993 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.207520    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:02.207993 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.207536    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:02.207993 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.207604    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:04.207575747 +0000 UTC m=+6.235394953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:02.559637 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.559544    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:02.560150 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.559692    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:02.560150 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.560112    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:02.560265 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:02.560206    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:02.618695 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.618531    2558 generic.go:358] "Generic (PLEG): container finished" podID="ff80c328d06fa711afd00a4156e7f026" containerID="3a8cf446dd1888f283aaa14f0efbde72f5f692baab3ffd0506ee2144b051a8af" exitCode=0
May 27 21:28:02.618695 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:02.618660    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"ff80c328d06fa711afd00a4156e7f026","Type":"ContainerDied","Data":"3a8cf446dd1888f283aaa14f0efbde72f5f692baab3ffd0506ee2144b051a8af"}
May 27 21:28:03.651428 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:03.651337    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" event={"ID":"ff80c328d06fa711afd00a4156e7f026","Type":"ContainerStarted","Data":"34b667f5751fc80be632de254f42af6fd8223a70ff5f6c386bfc648f4cfccfea"}
May 27 21:28:03.665220 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:03.665165    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-159.ec2.internal" podStartSLOduration=3.665147241 podStartE2EDuration="3.665147241s" podCreationTimestamp="2026-05-27 21:28:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:28:03.66471513 +0000 UTC m=+5.692534340" watchObservedRunningTime="2026-05-27 21:28:03.665147241 +0000 UTC m=+5.692966451"
May 27 21:28:04.123234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:04.122551    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:04.123234 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.122745    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:04.123234 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.122810    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:08.122792373 +0000 UTC m=+10.150611573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:04.223138 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:04.223096    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:04.223326 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.223295    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:04.223326 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.223315    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:04.223437 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.223328    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:04.223437 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.223384    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:08.223367086 +0000 UTC m=+10.251186281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:04.558792 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:04.558759    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:04.558976 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.558883    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:04.559330 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:04.559307    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:04.559434 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:04.559412    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:06.558318 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:06.558276    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:06.558318 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:06.558317    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:06.558758 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:06.558406    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:06.558758 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:06.558534    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:08.153236 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:08.153205    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:08.153716 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.153342    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:08.153716 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.153397    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:16.153384671 +0000 UTC m=+18.181203858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:08.253823 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:08.253785    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:08.254002 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.253962    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:08.254002 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.253982    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:08.254002 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.253994    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:08.254180 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.254049    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:16.254032175 +0000 UTC m=+18.281851376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:08.558629 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:08.558579    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:08.558777 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.558675    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:08.559243 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:08.559112    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:08.559243 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:08.559210    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:10.558704 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:10.558657    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:10.559129 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:10.558658    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:10.559129 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:10.558808    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:10.559129 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:10.558890    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:11.669033 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.668769    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cl522" event={"ID":"acf4e49c-cfdb-4ab2-8462-b3f90924f126","Type":"ContainerStarted","Data":"24ee6f5321cd05e258f975e55c1452acf57f51a463e054f612894818136da8bd"}
May 27 21:28:11.670426 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.670397    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerStarted","Data":"c4866e02ac1e4f70f6a00619f5b9dd36bb62d2240e48d6d89234b3299c5fa7e7"}
May 27 21:28:11.671928 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.671892    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f42f9" event={"ID":"495058c8-d1d1-4db5-89c1-8e457294f2cc","Type":"ContainerStarted","Data":"71c8c880cb6f91709357bc03a26e9dc5bca3f5b20d3b1ffccf25354445115fb1"}
May 27 21:28:11.673846 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.673824    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25xrt" event={"ID":"fc181868-c97c-456c-9e4e-430027a5fd67","Type":"ContainerStarted","Data":"24f9f873bc9ad7eccdb77a107dfe65b1536a4b0b3e2fb5c908942d6d6a27c86d"}
May 27 21:28:11.675238 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.675215    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cd4wq" event={"ID":"01b52d0d-16d1-46ad-8ffc-3708ff474d04","Type":"ContainerStarted","Data":"2f81c96503d25400e74546bbe0b8c0a004091f1af76ea8f33c329d21fcfa6fa3"}
May 27 21:28:11.677128 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.677062    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p" event={"ID":"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64","Type":"ContainerStarted","Data":"a873598eda6a06d51f852eb8c65dc811c472f663d268a7df5137a89cece7dfd5"}
May 27 21:28:11.697326 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.697282    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cl522" podStartSLOduration=3.72431309 podStartE2EDuration="13.697265575s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.237947255 +0000 UTC m=+3.265766442" lastFinishedPulling="2026-05-27 21:28:11.210899736 +0000 UTC m=+13.238718927" observedRunningTime="2026-05-27 21:28:11.68321385 +0000 UTC m=+13.711033061" watchObservedRunningTime="2026-05-27 21:28:11.697265575 +0000 UTC m=+13.725084801"
May 27 21:28:11.697452 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.697364    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cd4wq" podStartSLOduration=3.75559576 podStartE2EDuration="13.697359645s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.238185971 +0000 UTC m=+3.266005172" lastFinishedPulling="2026-05-27 21:28:11.179949855 +0000 UTC m=+13.207769057" observedRunningTime="2026-05-27 21:28:11.696826972 +0000 UTC m=+13.724646179" watchObservedRunningTime="2026-05-27 21:28:11.697359645 +0000 UTC m=+13.725178855"
May 27 21:28:11.729964 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.729907    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-25xrt" podStartSLOduration=3.7334631 podStartE2EDuration="13.729889557s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.241079948 +0000 UTC m=+3.268899138" lastFinishedPulling="2026-05-27 21:28:11.237506397 +0000 UTC m=+13.265325595" observedRunningTime="2026-05-27 21:28:11.70973189 +0000 UTC m=+13.737551100" watchObservedRunningTime="2026-05-27 21:28:11.729889557 +0000 UTC m=+13.757708766"
May 27 21:28:11.753262 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.753213    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f42f9" podStartSLOduration=3.8138221249999997 podStartE2EDuration="13.753199587s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.245565467 +0000 UTC m=+3.273384670" lastFinishedPulling="2026-05-27 21:28:11.184942944 +0000 UTC m=+13.212762132" observedRunningTime="2026-05-27 21:28:11.753069604 +0000 UTC m=+13.780888807" watchObservedRunningTime="2026-05-27 21:28:11.753199587 +0000 UTC m=+13.781018796"
May 27 21:28:11.985668 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.985634    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bthvn"]
May 27 21:28:11.988366 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:11.988343    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:11.988471 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:11.988424    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:12.084710 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.084667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-dbus\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.084874 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.084754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-kubelet-config\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.084874 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.084797    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.186135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.186099    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-dbus\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.186135 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.186155    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-kubelet-config\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.186383 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.186187    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.186383 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.186281    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-kubelet-config\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.186383 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.186297    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:12.186383 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.186367    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:12.686346487 +0000 UTC m=+14.714165676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:12.186566 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.186421    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/03e14bc4-fa47-4c13-833b-9e729aedf442-dbus\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.562095 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.562060    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:12.562272 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.562071    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:12.562272 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.562184    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:12.562272 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.562250    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:12.690149 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:12.690122    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:12.690695 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.690262    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:12.690695 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:12.690328    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:13.690310173 +0000 UTC m=+15.718129364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:13.558628 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:13.558558    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:13.558790 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:13.558723    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:13.681843 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:13.681804    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8g5m" event={"ID":"a827e92f-a16f-4a6f-bc42-0efcf335cdfd","Type":"ContainerStarted","Data":"c45cdf67f43200bdc379dde09da5ecddf08753d7ac8874ff87cf0462c56e5669"}
May 27 21:28:13.694326 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:13.694277    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8g5m" podStartSLOduration=5.753722557 podStartE2EDuration="15.694263299s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.243821315 +0000 UTC m=+3.271640527" lastFinishedPulling="2026-05-27 21:28:11.184362068 +0000 UTC m=+13.212181269" observedRunningTime="2026-05-27 21:28:13.694165815 +0000 UTC m=+15.721985025" watchObservedRunningTime="2026-05-27 21:28:13.694263299 +0000 UTC m=+15.722082509"
May 27 21:28:13.697402 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:13.697375    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:13.697543 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:13.697525    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:13.697626 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:13.697598    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:15.697578716 +0000 UTC m=+17.725397920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:14.558943 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:14.558907    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:14.558943 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:14.558929    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:14.559174 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:14.559048    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:14.559174 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:14.559143    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:15.558663 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:15.558635    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:15.559285 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:15.558761    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:15.711011 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:15.710979    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:15.711191 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:15.711163    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:15.711279 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:15.711264    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:19.71124106 +0000 UTC m=+21.739060251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:15.875383 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:15.875097    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:15.876062 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:15.876039    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:16.214260 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.214211    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:16.214428 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.214367    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:16.214505 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.214448    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:32.2144263 +0000 UTC m=+34.242245489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:16.315724 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.315672    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:16.315916 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.315854    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:16.315916 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.315878    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:16.315916 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.315891    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:16.316054 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.315961    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:28:32.315942589 +0000 UTC m=+34.343761799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:16.558271 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.558161    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:16.558271 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.558243    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:16.558471 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.558361    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:16.558659 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:16.558608    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:16.688910 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.688868    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="c4866e02ac1e4f70f6a00619f5b9dd36bb62d2240e48d6d89234b3299c5fa7e7" exitCode=0
May 27 21:28:16.689376 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:16.688944    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"c4866e02ac1e4f70f6a00619f5b9dd36bb62d2240e48d6d89234b3299c5fa7e7"}
May 27 21:28:17.558823 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:17.558782    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:17.559102 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:17.558920    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:18.561179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:18.561146    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:18.561574 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:18.561272    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:18.561782 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:18.561672    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:18.561782 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:18.561746    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:19.557981 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:19.557945    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:19.558147 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:19.558054    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:19.739862 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:19.739824    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:19.740228 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:19.739994    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:19.740228 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:19.740081    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:27.740058914 +0000 UTC m=+29.767878118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:20.104142 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.103951    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 27 21:28:20.558821 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.558629    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-27T21:28:20.104139631Z","UUID":"dd28ae80-3f4d-42b3-bc4d-cd4a13fb49da","Handler":null,"Name":"","Endpoint":""}
May 27 21:28:20.560411 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.560383    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 27 21:28:20.560411 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.560412    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 27 21:28:20.562211 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.562187    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:20.562298 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.562187    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:20.562351 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:20.562321    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:20.562396 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:20.562347    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:20.699326 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699290    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"dd8f2963cff771a112cdc06f6cf0973d0b64f8866d152ecf1eaa04731c041332"}
May 27 21:28:20.699326 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699327    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"c9ea6e9a6344d80b7aa096ce0a83ee385d9df59db5f161dff166bf8345ea5507"}
May 27 21:28:20.699326 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699336    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"b39bc77c6ae419add4e3518e08577d5fef8a93823063117307cd9871075b2e93"}
May 27 21:28:20.699580 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699345    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"cf383430507533ad2ebe51b3e3b828886475a9f59e585a954dee60191f425b9c"}
May 27 21:28:20.699580 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699354    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"a29e827839a527b812a859fb8ded1ee7e7d4bb3b287ea6f7325895b0dceabb35"}
May 27 21:28:20.699580 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.699363    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"852ac0f7b41c240ed39382b539b64f94fdd4d34424ffddb354aaa604e70cb576"}
May 27 21:28:20.700829 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.700800    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p" event={"ID":"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64","Type":"ContainerStarted","Data":"65ec9965eb46b365c55c79f1e9d195034f8674509c17f0cb854a48b1adf40b8f"}
May 27 21:28:20.702104 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.702082    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4jggt" event={"ID":"089c39ef-3460-472d-98e8-488986450b10","Type":"ContainerStarted","Data":"3ecb547c58554cadcf6c8297192342141bbc92d9eaed5a06f1a36f7cd65f6476"}
May 27 21:28:20.728019 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:20.727967    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4jggt" podStartSLOduration=4.070807326 podStartE2EDuration="22.727949744s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.244435296 +0000 UTC m=+3.272254496" lastFinishedPulling="2026-05-27 21:28:19.901577715 +0000 UTC m=+21.929396914" observedRunningTime="2026-05-27 21:28:20.72739799 +0000 UTC m=+22.755217203" watchObservedRunningTime="2026-05-27 21:28:20.727949744 +0000 UTC m=+22.755768954"
May 27 21:28:21.558571 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:21.558536    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:21.559065 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:21.558658    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:21.705161 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:21.705121    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p" event={"ID":"1af1a82b-f8de-4a28-9cb7-c9f4c802bc64","Type":"ContainerStarted","Data":"c711197d3c5ceaac885cb13371ab24fd4b44f674971b09dbbf2c63ca4567a573"}
May 27 21:28:21.723406 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:21.723363    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chl7p" podStartSLOduration=4.070071854 podStartE2EDuration="23.723352004s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.243074121 +0000 UTC m=+3.270893309" lastFinishedPulling="2026-05-27 21:28:20.89635427 +0000 UTC m=+22.924173459" observedRunningTime="2026-05-27 21:28:21.723244388 +0000 UTC m=+23.751063598" watchObservedRunningTime="2026-05-27 21:28:21.723352004 +0000 UTC m=+23.751171213"
May 27 21:28:22.558756 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:22.558720    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:22.559160 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:22.558854    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:22.559160 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:22.558895    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:22.559160 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:22.559013    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:22.709914 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:22.709880    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"41dc274b1e03711118d7b7dacb2b1d234f188c1e8d8b56cc0f991fb493dff517"}
May 27 21:28:23.558465 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:23.558428    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:23.558671 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:23.558554    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:24.558380 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:24.558345    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:24.558958 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:24.558363    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:24.558958 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:24.558478    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:24.558958 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:24.558582    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:25.558539 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.558123    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:25.558539 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:25.558229    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:25.718166 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.717981    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" event={"ID":"85d1deaa-c52f-4620-8b3e-d880165f7fdf","Type":"ContainerStarted","Data":"2880e1e8ff469195fcc51518290042c63af45b60a66b3bf0ea38e6be923e22e0"}
May 27 21:28:25.718301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.718175    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:25.718301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.718186    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:25.735073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.735047    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:25.752925 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:25.752881    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4" podStartSLOduration=9.099925938 podStartE2EDuration="27.75286848s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.248792989 +0000 UTC m=+3.276612179" lastFinishedPulling="2026-05-27 21:28:19.901735531 +0000 UTC m=+21.929554721" observedRunningTime="2026-05-27 21:28:25.752713276 +0000 UTC m=+27.780532486" watchObservedRunningTime="2026-05-27 21:28:25.75286848 +0000 UTC m=+27.780687700"
May 27 21:28:26.493353 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.493320    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:26.493509 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.493448    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 27 21:28:26.493922 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.493902    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f42f9"
May 27 21:28:26.559021 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.558990    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:26.559403 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:26.559089    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:26.559403 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.559151    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:26.559403 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:26.559276    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:26.725230 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.725194    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="ff36662f969dd342b24d0fc40ff3d82d9da6d1c7cc592ca4b49be9fd5a0a28ae" exitCode=0
May 27 21:28:26.725379 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.725271    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"ff36662f969dd342b24d0fc40ff3d82d9da6d1c7cc592ca4b49be9fd5a0a28ae"}
May 27 21:28:26.725976 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.725932    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:26.744304 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:26.744241    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:28:27.488571 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.488539    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwkkv"]
May 27 21:28:27.488740 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.488703    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:27.488838 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:27.488814    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:27.491751 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.491727    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bthvn"]
May 27 21:28:27.491856 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.491842    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:27.491964 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:27.491945    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:27.503651 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.503628    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vqzh"]
May 27 21:28:27.503786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.503723    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:27.503847 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:27.503810    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:27.805483 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:27.805407    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:27.805926 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:27.805563    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 27 21:28:27.805926 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:27.805661    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret podName:03e14bc4-fa47-4c13-833b-9e729aedf442 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:43.805640113 +0000 UTC m=+45.833459302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret") pod "global-pull-secret-syncer-bthvn" (UID: "03e14bc4-fa47-4c13-833b-9e729aedf442") : object "kube-system"/"original-pull-secret" not registered
May 27 21:28:28.730763 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:28.730728    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="4ef81add9dbf86cc9512b914eb0d88fd628c5acc63f1a25d4c9847f88d8cb7e7" exitCode=0
May 27 21:28:28.730946 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:28.730803    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"4ef81add9dbf86cc9512b914eb0d88fd628c5acc63f1a25d4c9847f88d8cb7e7"}
May 27 21:28:29.558259 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:29.558026    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:29.558594 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:29.558026    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:29.558594 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:29.558352    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:29.558594 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:29.558124    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:29.558594 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:29.558460    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:29.558594 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:29.558530    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:30.736462 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:30.736424    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="9c945d4a25df0d476da9d1a1be3a676304e27198dc7ac5214ff6043ea0e47d30" exitCode=0
May 27 21:28:30.736926 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:30.736481    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"9c945d4a25df0d476da9d1a1be3a676304e27198dc7ac5214ff6043ea0e47d30"}
May 27 21:28:31.558702 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:31.558663    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:31.558880 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:31.558664    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:31.558880 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:31.558808    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:28:31.558987 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:31.558889    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bthvn" podUID="03e14bc4-fa47-4c13-833b-9e729aedf442"
May 27 21:28:31.558987 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:31.558662    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:31.558987 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:31.558974    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rwkkv" podUID="7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e"
May 27 21:28:32.239889 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.239856    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:32.240405 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.239997    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:32.240405 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.240062    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.240045823 +0000 UTC m=+66.267865010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 27 21:28:32.340389 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.340348    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:32.340540 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.340514    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 27 21:28:32.340540 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.340537    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 27 21:28:32.340646 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.340550    2558 projected.go:194] Error preparing data for projected volume kube-api-access-fxhwv for pod openshift-network-diagnostics/network-check-target-rwkkv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:32.340646 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:32.340628    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv podName:7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.340594472 +0000 UTC m=+66.368413681 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fxhwv" (UniqueName: "kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv") pod "network-check-target-rwkkv" (UID: "7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 27 21:28:32.807584 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.807546    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-159.ec2.internal" event="NodeReady"
May 27 21:28:32.807780 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.807761    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 27 21:28:32.848794 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.847951    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"]
May 27 21:28:32.865150 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.865124    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"]
May 27 21:28:32.865287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.865276    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:32.868268 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.868242    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 27 21:28:32.868528 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.868499    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 27 21:28:32.869284 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.869126    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pggqj\""
May 27 21:28:32.879200 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.879175    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"]
May 27 21:28:32.879353 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.879333    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:32.882427 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882402    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 27 21:28:32.882548 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882404    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 27 21:28:32.882548 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882523    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 27 21:28:32.882770 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882658    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 27 21:28:32.882893 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882874    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 27 21:28:32.882989 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.882949    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 27 21:28:32.883890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.883824    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 27 21:28:32.895244 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.895225    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"]
May 27 21:28:32.895383 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.895366    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:32.897803 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.897785    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-2zz4t\""
May 27 21:28:32.897926 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.897907    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 27 21:28:32.913315 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.913295    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:28:32.913455 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.913437    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:32.916174 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.916156    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 27 21:28:32.926437 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.926415    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"]
May 27 21:28:32.926543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.926442    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"]
May 27 21:28:32.926543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.926451    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"]
May 27 21:28:32.926543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.926463    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8b9tz"]
May 27 21:28:32.926742 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.926550    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:32.929285 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.929266    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 27 21:28:32.929489 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.929474    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 27 21:28:32.930307 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.930290    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8rshs\""
May 27 21:28:32.930601 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.930585    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 27 21:28:32.942830 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.942811    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:28:32.942830 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.942833    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"]
May 27 21:28:32.942944 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.942842    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8b9tz"]
May 27 21:28:32.942944 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.942917    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:32.943404 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.943386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:32.943465 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.943449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6501eee3-044c-4f2a-98b1-fbcb73685ada-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:32.944795 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.944777    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 27 21:28:32.945364 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.945347    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 27 21:28:32.945422 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.945364    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vmd24\""
May 27 21:28:32.945422 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.945348    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 27 21:28:32.945422 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.945402    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 27 21:28:32.962964 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.962933    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vjsjf"]
May 27 21:28:32.983188 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.983156    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:32.983722 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.983690    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjsjf"]
May 27 21:28:32.985609 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.985587    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xztv5\""
May 27 21:28:32.985738 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.985608    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 27 21:28:32.985738 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:32.985592    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 27 21:28:33.044276 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.044276 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s767b\" (UniqueName: \"kubernetes.io/projected/8619c2a1-ef70-410d-9b6b-5491ee9974d7-kube-api-access-s767b\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbn79\" (UniqueName: \"kubernetes.io/projected/c861d8f4-f37e-45aa-8ea1-90eb67791059-kube-api-access-fbn79\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lflc9\" (UniqueName: \"kubernetes.io/projected/4827cbc0-8b56-42b9-9083-5c80904f140e-kube-api-access-lflc9\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044344    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb25b2b7-46f7-447b-86ec-30cbec8d4228-tmp\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c861d8f4-f37e-45aa-8ea1-90eb67791059-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044453    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044504 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044537    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb25b2b7-46f7-447b-86ec-30cbec8d4228-klusterlet-config\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4827cbc0-8b56-42b9-9083-5c80904f140e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044648    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6501eee3-044c-4f2a-98b1-fbcb73685ada-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbks4\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kd8m\" (UniqueName: \"kubernetes.io/projected/fb25b2b7-46f7-447b-86ec-30cbec8d4228-kube-api-access-7kd8m\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044811    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044843    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:33.044890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.045248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.045248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.045248 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.044943    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:33.045248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.044984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.045248 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.045012    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:28:33.544993472 +0000 UTC m=+35.572812681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:33.045399 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.045375    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6501eee3-044c-4f2a-98b1-fbcb73685ada-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:33.145459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145364    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fbn79\" (UniqueName: \"kubernetes.io/projected/c861d8f4-f37e-45aa-8ea1-90eb67791059-kube-api-access-fbn79\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.145459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145404    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.145459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-config-volume\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.145459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145444    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-tmp-dir\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.145807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145486    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb25b2b7-46f7-447b-86ec-30cbec8d4228-tmp\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.145807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145520    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.145807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145547    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb25b2b7-46f7-447b-86ec-30cbec8d4228-klusterlet-config\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.145807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145572    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4827cbc0-8b56-42b9-9083-5c80904f140e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.145807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.145638    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7kd8m\" (UniqueName: \"kubernetes.io/projected/fb25b2b7-46f7-447b-86ec-30cbec8d4228-kube-api-access-7kd8m\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.146132 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146094    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.146210 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146192    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lflc9\" (UniqueName: \"kubernetes.io/projected/4827cbc0-8b56-42b9-9083-5c80904f140e-kube-api-access-lflc9\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.146268 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146237    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.146268 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146254    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb25b2b7-46f7-447b-86ec-30cbec8d4228-tmp\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.146368 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146269    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.146368 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146305    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.146368 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146331    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s767b\" (UniqueName: \"kubernetes.io/projected/8619c2a1-ef70-410d-9b6b-5491ee9974d7-kube-api-access-s767b\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.146727 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.146705    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.146884 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.146867    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:33.146967 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.146948    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:33.646926168 +0000 UTC m=+35.674745371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147320    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147424    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c861d8f4-f37e-45aa-8ea1-90eb67791059-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147447    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147604    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.147799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz94g\" (UniqueName: \"kubernetes.io/projected/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-kube-api-access-sz94g\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148104    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbks4\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148145    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148180    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.148650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148416    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/c861d8f4-f37e-45aa-8ea1-90eb67791059-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.149486 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.148901    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.149486 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.149045    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:33.149486 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.149063    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:33.149486 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.149128    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:28:33.649111838 +0000 UTC m=+35.676931042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:33.152084 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.152041    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.154229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.152903    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-ca\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.154229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.153077    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-hub\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.154229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.153466    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.154229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.153877    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c861d8f4-f37e-45aa-8ea1-90eb67791059-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.154229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.154115    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.155489 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.155465    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4827cbc0-8b56-42b9-9083-5c80904f140e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.155744 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.155718    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fb25b2b7-46f7-447b-86ec-30cbec8d4228-klusterlet-config\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.157388 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.157354    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.158566 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.158493    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbn79\" (UniqueName: \"kubernetes.io/projected/c861d8f4-f37e-45aa-8ea1-90eb67791059-kube-api-access-fbn79\") pod \"cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj\" (UID: \"c861d8f4-f37e-45aa-8ea1-90eb67791059\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.159144 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.159119    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lflc9\" (UniqueName: \"kubernetes.io/projected/4827cbc0-8b56-42b9-9083-5c80904f140e-kube-api-access-lflc9\") pod \"managed-serviceaccount-addon-agent-59cf55b5db-mc7fg\" (UID: \"4827cbc0-8b56-42b9-9083-5c80904f140e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.159571 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.159538    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s767b\" (UniqueName: \"kubernetes.io/projected/8619c2a1-ef70-410d-9b6b-5491ee9974d7-kube-api-access-s767b\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.160021 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.160001    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kd8m\" (UniqueName: \"kubernetes.io/projected/fb25b2b7-46f7-447b-86ec-30cbec8d4228-kube-api-access-7kd8m\") pod \"klusterlet-addon-workmgr-657bf869fb-qhh5x\" (UID: \"fb25b2b7-46f7-447b-86ec-30cbec8d4228\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.160151 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.160134    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbks4\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.202340 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.202307    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:28:33.209193 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.209160    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"
May 27 21:28:33.241519 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.241482    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:33.249115 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.249082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.249264 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.249130    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sz94g\" (UniqueName: \"kubernetes.io/projected/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-kube-api-access-sz94g\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.249264 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.249204    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-config-volume\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.249264 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.249232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-tmp-dir\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.249264 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.249245    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:33.250103 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.249584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-tmp-dir\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.250103 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.249703    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:28:33.749677627 +0000 UTC m=+35.777496830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:33.250103 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.250057    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-config-volume\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.258933 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.258885    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz94g\" (UniqueName: \"kubernetes.io/projected/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-kube-api-access-sz94g\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.400072 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.400008    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg"]
May 27 21:28:33.403119 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.403099    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"]
May 27 21:28:33.405269 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:33.405225    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4827cbc0_8b56_42b9_9083_5c80904f140e.slice/crio-38753572a61ba6396890407e6e89c6226514389106c5df1b196f32c1105f1317 WatchSource:0}: Error finding container 38753572a61ba6396890407e6e89c6226514389106c5df1b196f32c1105f1317: Status 404 returned error can't find the container with id 38753572a61ba6396890407e6e89c6226514389106c5df1b196f32c1105f1317
May 27 21:28:33.407348 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:33.407325    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc861d8f4_f37e_45aa_8ea1_90eb67791059.slice/crio-3c100a53990c24626344dfbb18fc6496cff0bafca955e2120c37d7c342182b7a WatchSource:0}: Error finding container 3c100a53990c24626344dfbb18fc6496cff0bafca955e2120c37d7c342182b7a: Status 404 returned error can't find the container with id 3c100a53990c24626344dfbb18fc6496cff0bafca955e2120c37d7c342182b7a
May 27 21:28:33.416657 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.416634    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"]
May 27 21:28:33.419415 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:33.419394    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb25b2b7_46f7_447b_86ec_30cbec8d4228.slice/crio-1f621289749eb857b76be05ae192f9b754d84dcfbbb91d11d709c9666d76b4ab WatchSource:0}: Error finding container 1f621289749eb857b76be05ae192f9b754d84dcfbbb91d11d709c9666d76b4ab: Status 404 returned error can't find the container with id 1f621289749eb857b76be05ae192f9b754d84dcfbbb91d11d709c9666d76b4ab
May 27 21:28:33.551661 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.551607    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:33.551829 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.551759    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:33.551871 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.551830    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:28:34.551809805 +0000 UTC m=+36.579628992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:33.558720 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.558696    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:28:33.558720 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.558718    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:33.558921 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.558743    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:28:33.561852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561533    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 27 21:28:33.561852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561529    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 21:28:33.561852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561697    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 21:28:33.561852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561707    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5jvq\""
May 27 21:28:33.561852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561747    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 21:28:33.562140 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.561828    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdzf7\""
May 27 21:28:33.652917 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.652811    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:33.652917 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.652907    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:33.653087 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.652968    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:33.653087 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.652984    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:33.653087 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.652985    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:33.653087 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.653032    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:34.653018333 +0000 UTC m=+36.680837521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:33.653087 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.653045    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:28:34.653039567 +0000 UTC m=+36.680858753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:33.743432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.743391    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" event={"ID":"fb25b2b7-46f7-447b-86ec-30cbec8d4228","Type":"ContainerStarted","Data":"1f621289749eb857b76be05ae192f9b754d84dcfbbb91d11d709c9666d76b4ab"}
May 27 21:28:33.744543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.744504    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerStarted","Data":"3c100a53990c24626344dfbb18fc6496cff0bafca955e2120c37d7c342182b7a"}
May 27 21:28:33.745571 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.745550    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg" event={"ID":"4827cbc0-8b56-42b9-9083-5c80904f140e","Type":"ContainerStarted","Data":"38753572a61ba6396890407e6e89c6226514389106c5df1b196f32c1105f1317"}
May 27 21:28:33.754169 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:33.754144    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:33.754313 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.754296    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:33.754375 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:33.754367    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:28:34.754348331 +0000 UTC m=+36.782167536 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:34.563266 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:34.563233    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:34.563780 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.563393    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:34.563780 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.563464    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:28:36.56344327 +0000 UTC m=+38.591262494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:34.664144 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:34.663981    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:34.664144 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:34.664070    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:34.664390 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.664167    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:34.664390 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.664210    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:34.664390 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.664227    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:34.664390 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.664242    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:36.664221693 +0000 UTC m=+38.692040893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:34.664390 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.664288    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:28:36.664272499 +0000 UTC m=+38.692091699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:34.765632 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:34.765566    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:34.765843 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.765825    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:34.765914 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:34.765903    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:28:36.765884199 +0000 UTC m=+38.793703400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:36.585800 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:36.585767    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:36.586264 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.585966    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:36.586264 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.586045    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:28:40.586025377 +0000 UTC m=+42.613844579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:36.687049 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:36.687000    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:36.687228 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:36.687085    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:36.687228 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.687219    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:36.687351 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.687235    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:36.687351 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.687292    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:28:40.687273643 +0000 UTC m=+42.715092864 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:36.687657 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.687551    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:36.687657 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.687630    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:40.687593691 +0000 UTC m=+42.715412883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:36.788009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:36.787935    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:36.788575 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.788203    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:36.788575 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:36.788275    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:28:40.788256445 +0000 UTC m=+42.816075645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:40.623331 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:40.623284    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:40.623853 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.623460    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:40.623853 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.623551    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:28:48.6235292 +0000 UTC m=+50.651348390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:40.723760 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:40.723719    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:40.723942 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:40.723791    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:40.723942 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.723881    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:40.724038 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.723951    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:28:48.723935497 +0000 UTC m=+50.751754688 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:40.724038 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.723951    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:40.724038 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.723977    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:40.724038 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.724032    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:28:48.724014303 +0000 UTC m=+50.751833513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:40.825276 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:40.825236    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:40.825453 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.825381    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:40.825453 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:40.825441    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:28:48.825425039 +0000 UTC m=+50.853244243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:43.775273 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.775087    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="3f45b34d75abe385bd114ea50d51c8488a9aeadfb732bab1ee23824cd9c030c5" exitCode=0
May 27 21:28:43.775807 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.775163    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"3f45b34d75abe385bd114ea50d51c8488a9aeadfb732bab1ee23824cd9c030c5"}
May 27 21:28:43.776739 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.776715    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" event={"ID":"fb25b2b7-46f7-447b-86ec-30cbec8d4228","Type":"ContainerStarted","Data":"f70cbb8e0b725040b44c9efc1759a0e220c1f583c66900ecae0a5ade857f9c77"}
May 27 21:28:43.776911 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.776892    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:43.778127 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.778105    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerStarted","Data":"d4332578925d1ccfb4eee0d9bc8f86643a2d9aba0dbf21511afe68173be9c190"}
May 27 21:28:43.778844 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.778828    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:28:43.779646 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.779626    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg" event={"ID":"4827cbc0-8b56-42b9-9083-5c80904f140e","Type":"ContainerStarted","Data":"532584a4a9c28bb4e584823640cbb138e1d0ba5070b537df2f7ce19f3daf9c09"}
May 27 21:28:43.821926 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.821826    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" podStartSLOduration=9.918348554 podStartE2EDuration="19.821812311s" podCreationTimestamp="2026-05-27 21:28:24 +0000 UTC" firstStartedPulling="2026-05-27 21:28:33.421579944 +0000 UTC m=+35.449399132" lastFinishedPulling="2026-05-27 21:28:43.325043683 +0000 UTC m=+45.352862889" observedRunningTime="2026-05-27 21:28:43.821353407 +0000 UTC m=+45.849172613" watchObservedRunningTime="2026-05-27 21:28:43.821812311 +0000 UTC m=+45.849631516"
May 27 21:28:43.840394 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.840352    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg" podStartSLOduration=9.945834939000001 podStartE2EDuration="19.840336938s" podCreationTimestamp="2026-05-27 21:28:24 +0000 UTC" firstStartedPulling="2026-05-27 21:28:33.40720208 +0000 UTC m=+35.435021281" lastFinishedPulling="2026-05-27 21:28:43.301704079 +0000 UTC m=+45.329523280" observedRunningTime="2026-05-27 21:28:43.839814532 +0000 UTC m=+45.867633932" watchObservedRunningTime="2026-05-27 21:28:43.840336938 +0000 UTC m=+45.868156141"
May 27 21:28:43.853940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.853912    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:43.858070 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:43.858044    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/03e14bc4-fa47-4c13-833b-9e729aedf442-original-pull-secret\") pod \"global-pull-secret-syncer-bthvn\" (UID: \"03e14bc4-fa47-4c13-833b-9e729aedf442\") " pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:44.070288 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:44.070251    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bthvn"
May 27 21:28:44.214862 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:44.214820    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bthvn"]
May 27 21:28:44.221029 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:28:44.221001    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e14bc4_fa47_4c13_833b_9e729aedf442.slice/crio-b8a46dac723516a69ecd11fcdff3b102978f3a034d57cca02f664772892c2335 WatchSource:0}: Error finding container b8a46dac723516a69ecd11fcdff3b102978f3a034d57cca02f664772892c2335: Status 404 returned error can't find the container with id b8a46dac723516a69ecd11fcdff3b102978f3a034d57cca02f664772892c2335
May 27 21:28:44.785406 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:44.785167    2558 generic.go:358] "Generic (PLEG): container finished" podID="02e3acb1-bd19-4356-ac08-690841ffbf76" containerID="2c9eee323cf4f4d5f0abf80729f7c4a67e29d29c3233b0ef34f434261d94b136" exitCode=0
May 27 21:28:44.786125 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:44.785239    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerDied","Data":"2c9eee323cf4f4d5f0abf80729f7c4a67e29d29c3233b0ef34f434261d94b136"}
May 27 21:28:44.787199 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:44.787174    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bthvn" event={"ID":"03e14bc4-fa47-4c13-833b-9e729aedf442","Type":"ContainerStarted","Data":"b8a46dac723516a69ecd11fcdff3b102978f3a034d57cca02f664772892c2335"}
May 27 21:28:45.792786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:45.792749    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fv45z" event={"ID":"02e3acb1-bd19-4356-ac08-690841ffbf76","Type":"ContainerStarted","Data":"9418e2e10dfd4617821acd9b7655150391a6615127626c6f484294e6cf6764c7"}
May 27 21:28:45.794647 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:45.794601    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerStarted","Data":"570aa16635123d724db6e7b73239e980f6724e832b49db0e7fc3ad5a1d29ffac"}
May 27 21:28:45.794760 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:45.794652    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerStarted","Data":"5a038a1e5fa880e2846ac945cdb6b6da6457afd61ba585115086b7c1d929be26"}
May 27 21:28:45.832175 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:45.832125    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fv45z" podStartSLOduration=5.7766317560000005 podStartE2EDuration="47.83210708s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:28:01.250051965 +0000 UTC m=+3.277871152" lastFinishedPulling="2026-05-27 21:28:43.305527288 +0000 UTC m=+45.333346476" observedRunningTime="2026-05-27 21:28:45.817439834 +0000 UTC m=+47.845259042" watchObservedRunningTime="2026-05-27 21:28:45.83210708 +0000 UTC m=+47.859926296"
May 27 21:28:45.861060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:45.861010    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" podStartSLOduration=9.984670847 podStartE2EDuration="21.860992567s" podCreationTimestamp="2026-05-27 21:28:24 +0000 UTC" firstStartedPulling="2026-05-27 21:28:33.409139526 +0000 UTC m=+35.436958724" lastFinishedPulling="2026-05-27 21:28:45.285461245 +0000 UTC m=+47.313280444" observedRunningTime="2026-05-27 21:28:45.859755708 +0000 UTC m=+47.887574920" watchObservedRunningTime="2026-05-27 21:28:45.860992567 +0000 UTC m=+47.888811775"
May 27 21:28:48.697691 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.697656    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:28:48.697995 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.697781    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:28:48.697995 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.697844    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.697829514 +0000 UTC m=+66.725648707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:28:48.798939 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.798789    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:28:48.798939 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.798859    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:28:48.799159 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.799053    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:28:48.799159 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.799067    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:28:48.799159 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.799118    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.799099145 +0000 UTC m=+66.826918345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:28:48.799323 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.799178    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:28:48.799323 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.799208    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.799198461 +0000 UTC m=+66.827017652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:28:48.802659 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.802633    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bthvn" event={"ID":"03e14bc4-fa47-4c13-833b-9e729aedf442","Type":"ContainerStarted","Data":"5a05cee2adb196c385ada0e8346fa0c174656d771ed21d3b73916ffbd1e03d11"}
May 27 21:28:48.825460 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.825266    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bthvn" podStartSLOduration=33.431598463 podStartE2EDuration="37.825248205s" podCreationTimestamp="2026-05-27 21:28:11 +0000 UTC" firstStartedPulling="2026-05-27 21:28:44.222735435 +0000 UTC m=+46.250554636" lastFinishedPulling="2026-05-27 21:28:48.616385187 +0000 UTC m=+50.644204378" observedRunningTime="2026-05-27 21:28:48.823974139 +0000 UTC m=+50.851793347" watchObservedRunningTime="2026-05-27 21:28:48.825248205 +0000 UTC m=+50.853067415"
May 27 21:28:48.899423 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:48.899341    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:28:48.899572 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.899508    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:28:48.899635 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:28:48.899592    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:29:04.899568842 +0000 UTC m=+66.927388044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:28:58.742559 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:28:58.742521    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vv2w4"
May 27 21:29:04.323870 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.323817    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:29:04.326630 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.326596    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 27 21:29:04.334666 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.334645    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 21:29:04.334771 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.334718    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:08.334697047 +0000 UTC m=+130.362516235 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : secret "metrics-daemon-secret" not found
May 27 21:29:04.425167 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.425115    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:29:04.427892 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.427874    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 27 21:29:04.437721 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.437697    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 27 21:29:04.449679 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.449654    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxhwv\" (UniqueName: \"kubernetes.io/projected/7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e-kube-api-access-fxhwv\") pod \"network-check-target-rwkkv\" (UID: \"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e\") " pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:29:04.478327 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.478298    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5jvq\""
May 27 21:29:04.486475 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.486454    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:29:04.612653 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.612553    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rwkkv"]
May 27 21:29:04.616024 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:29:04.615996    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfcf4ef_f1e2_4f84_b31d_5ba86918c30e.slice/crio-deb95dcb2116a0d2cb9d16aa96a80caaa0917aee6da2b072ca7484ca51967b85 WatchSource:0}: Error finding container deb95dcb2116a0d2cb9d16aa96a80caaa0917aee6da2b072ca7484ca51967b85: Status 404 returned error can't find the container with id deb95dcb2116a0d2cb9d16aa96a80caaa0917aee6da2b072ca7484ca51967b85
May 27 21:29:04.727400 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.727361    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:29:04.727601 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.727537    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:29:04.727706 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.727650    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:29:36.727601992 +0000 UTC m=+98.755421179 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:29:04.828480 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.828435    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:29:04.828687 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.828502    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:29:04.828687 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.828590    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:29:04.828687 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.828592    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:29:04.828687 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.828601    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:29:04.828687 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.828677    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:29:36.828663656 +0000 UTC m=+98.856482843 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:29:04.828953 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.828693    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:29:36.828686011 +0000 UTC m=+98.856505198 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:29:04.842708 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.842679    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwkkv" event={"ID":"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e","Type":"ContainerStarted","Data":"deb95dcb2116a0d2cb9d16aa96a80caaa0917aee6da2b072ca7484ca51967b85"}
May 27 21:29:04.929488 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:04.929415    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:29:04.929643 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.929527    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:29:04.929643 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:04.929578    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:29:36.929564729 +0000 UTC m=+98.957383915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:29:07.850970 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:07.850934    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rwkkv" event={"ID":"7bfcf4ef-f1e2-4f84-b31d-5ba86918c30e","Type":"ContainerStarted","Data":"a4e3db52e72f02474c1f55afc34c143be9537e2da80b28dbc6d9d748e94aa61d"}
May 27 21:29:07.851365 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:07.851159    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:29:07.867902 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:07.867858    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rwkkv" podStartSLOduration=67.062038043 podStartE2EDuration="1m9.867847025s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:29:04.617980272 +0000 UTC m=+66.645799460" lastFinishedPulling="2026-05-27 21:29:07.423789251 +0000 UTC m=+69.451608442" observedRunningTime="2026-05-27 21:29:07.867241421 +0000 UTC m=+69.895060630" watchObservedRunningTime="2026-05-27 21:29:07.867847025 +0000 UTC m=+69.895666234"
May 27 21:29:36.777230 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:36.777167    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:29:36.777811 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.777331    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:29:36.777811 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.777428    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:30:40.777406436 +0000 UTC m=+162.805225824 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:29:36.878407 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:36.878369    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:29:36.878560 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:36.878423    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:29:36.878560 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.878516    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 27 21:29:36.878560 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.878528    2558 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 27 21:29:36.878560 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.878538    2558 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57dfd45b54-4bqmx: secret "image-registry-tls" not found
May 27 21:29:36.878738 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.878584    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls podName:ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec nodeName:}" failed. No retries permitted until 2026-05-27 21:30:40.878571631 +0000 UTC m=+162.906390818 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls") pod "image-registry-57dfd45b54-4bqmx" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec") : secret "image-registry-tls" not found
May 27 21:29:36.878738 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.878595    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert podName:8619c2a1-ef70-410d-9b6b-5491ee9974d7 nodeName:}" failed. No retries permitted until 2026-05-27 21:30:40.878589915 +0000 UTC m=+162.906409102 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert") pod "ingress-canary-8b9tz" (UID: "8619c2a1-ef70-410d-9b6b-5491ee9974d7") : secret "canary-serving-cert" not found
May 27 21:29:36.979777 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:36.979720    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:29:36.979949 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.979866    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 27 21:29:36.979949 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:29:36.979930    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls podName:cd71dd77-9b8b-4e7c-808a-66f8403e3dab nodeName:}" failed. No retries permitted until 2026-05-27 21:30:40.979914796 +0000 UTC m=+163.007733984 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls") pod "dns-default-vjsjf" (UID: "cd71dd77-9b8b-4e7c-808a-66f8403e3dab") : secret "dns-default-metrics-tls" not found
May 27 21:29:38.855826 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:29:38.855791    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rwkkv"
May 27 21:30:08.418347 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:08.418311    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:30:08.418839 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:08.418460    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 27 21:30:08.418839 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:08.418529    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs podName:0e37582f-501f-48e0-ace0-4f5640789b07 nodeName:}" failed. No retries permitted until 2026-05-27 21:32:10.418515706 +0000 UTC m=+252.446334893 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs") pod "network-metrics-daemon-2vqzh" (UID: "0e37582f-501f-48e0-ace0-4f5640789b07") : secret "metrics-daemon-secret" not found
May 27 21:30:26.956074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:26.956045    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cl522_acf4e49c-cfdb-4ab2-8462-b3f90924f126/dns-node-resolver/0.log"
May 27 21:30:27.953997 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:27.953970    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cd4wq_01b52d0d-16d1-46ad-8ffc-3708ff474d04/node-ca/0.log"
May 27 21:30:35.878386 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:35.878336    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk" podUID="6501eee3-044c-4f2a-98b1-fbcb73685ada"
May 27 21:30:35.939101 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:35.939069    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"
May 27 21:30:35.950724 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:35.950693    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8b9tz" podUID="8619c2a1-ef70-410d-9b6b-5491ee9974d7"
May 27 21:30:35.993279 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:35.993250    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vjsjf" podUID="cd71dd77-9b8b-4e7c-808a-66f8403e3dab"
May 27 21:30:36.064607 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:36.064578    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:36.064748 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:36.064634    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:30:36.064787 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:36.064761    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:30:36.064858 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:36.064842    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:30:36.582190 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:36.582156    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2vqzh" podUID="0e37582f-501f-48e0-ace0-4f5640789b07"
May 27 21:30:40.876502 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:40.876463    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:30:40.876965 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:40.876633    2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 27 21:30:40.876965 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:30:40.876725    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert podName:6501eee3-044c-4f2a-98b1-fbcb73685ada nodeName:}" failed. No retries permitted until 2026-05-27 21:32:42.876708661 +0000 UTC m=+284.904527848 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-z6nkk" (UID: "6501eee3-044c-4f2a-98b1-fbcb73685ada") : secret "networking-console-plugin-cert" not found
May 27 21:30:40.977832 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:40.977795    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:30:40.977994 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:40.977902    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:30:40.980432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:40.980407    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"image-registry-57dfd45b54-4bqmx\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") " pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:30:40.980432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:40.980427    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8619c2a1-ef70-410d-9b6b-5491ee9974d7-cert\") pod \"ingress-canary-8b9tz\" (UID: \"8619c2a1-ef70-410d-9b6b-5491ee9974d7\") " pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:30:41.079252 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.079221    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:41.081546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.081526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd71dd77-9b8b-4e7c-808a-66f8403e3dab-metrics-tls\") pod \"dns-default-vjsjf\" (UID: \"cd71dd77-9b8b-4e7c-808a-66f8403e3dab\") " pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:41.174287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.174201    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8rshs\""
May 27 21:30:41.174287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.174203    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vmd24\""
May 27 21:30:41.174287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.174209    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xztv5\""
May 27 21:30:41.176314 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.176298    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:41.176400 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.176304    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8b9tz"
May 27 21:30:41.176481 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.176328    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:30:41.326488 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.326461    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8b9tz"]
May 27 21:30:41.328048 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:30:41.328023    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8619c2a1_ef70_410d_9b6b_5491ee9974d7.slice/crio-8778d0dba21baea0923e0c8fa8b1d4aede3cc694dbc3de64ec7c18120c28bbc6 WatchSource:0}: Error finding container 8778d0dba21baea0923e0c8fa8b1d4aede3cc694dbc3de64ec7c18120c28bbc6: Status 404 returned error can't find the container with id 8778d0dba21baea0923e0c8fa8b1d4aede3cc694dbc3de64ec7c18120c28bbc6
May 27 21:30:41.556310 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.556278    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:30:41.559135 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:30:41.559107    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd470e7_0e58_4b3a_bb9a_473c6d7d56ec.slice/crio-abc33f87ee831e6b7fc9479471bcc08b3bfaf6bb37d27cf573f09d9acd3e4e09 WatchSource:0}: Error finding container abc33f87ee831e6b7fc9479471bcc08b3bfaf6bb37d27cf573f09d9acd3e4e09: Status 404 returned error can't find the container with id abc33f87ee831e6b7fc9479471bcc08b3bfaf6bb37d27cf573f09d9acd3e4e09
May 27 21:30:41.560468 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:41.560447    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjsjf"]
May 27 21:30:41.563216 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:30:41.563190    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd71dd77_9b8b_4e7c_808a_66f8403e3dab.slice/crio-5e588cb63aa5fb056210720905ca6130b09c2a8f739ba3249bf9984fe95783bc WatchSource:0}: Error finding container 5e588cb63aa5fb056210720905ca6130b09c2a8f739ba3249bf9984fe95783bc: Status 404 returned error can't find the container with id 5e588cb63aa5fb056210720905ca6130b09c2a8f739ba3249bf9984fe95783bc
May 27 21:30:42.078563 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.078531    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8b9tz" event={"ID":"8619c2a1-ef70-410d-9b6b-5491ee9974d7","Type":"ContainerStarted","Data":"8778d0dba21baea0923e0c8fa8b1d4aede3cc694dbc3de64ec7c18120c28bbc6"}
May 27 21:30:42.080032 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.080000    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" event={"ID":"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec","Type":"ContainerStarted","Data":"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"}
May 27 21:30:42.080176 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.080042    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" event={"ID":"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec","Type":"ContainerStarted","Data":"abc33f87ee831e6b7fc9479471bcc08b3bfaf6bb37d27cf573f09d9acd3e4e09"}
May 27 21:30:42.080176 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.080102    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:30:42.081202 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.081182    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjsjf" event={"ID":"cd71dd77-9b8b-4e7c-808a-66f8403e3dab","Type":"ContainerStarted","Data":"5e588cb63aa5fb056210720905ca6130b09c2a8f739ba3249bf9984fe95783bc"}
May 27 21:30:42.129033 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:42.128978    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" podStartSLOduration=163.128960764 podStartE2EDuration="2m43.128960764s" podCreationTimestamp="2026-05-27 21:27:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:30:42.114114831 +0000 UTC m=+164.141934040" watchObservedRunningTime="2026-05-27 21:30:42.128960764 +0000 UTC m=+164.156779974"
May 27 21:30:43.777818 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:43.777769    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" podUID="fb25b2b7-46f7-447b-86ec-30cbec8d4228" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
May 27 21:30:44.088153 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.088059    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjsjf" event={"ID":"cd71dd77-9b8b-4e7c-808a-66f8403e3dab","Type":"ContainerStarted","Data":"60e046a82dd37990080131aff0c78670a93b33869e7a2dac50a9f1544aa7e6d6"}
May 27 21:30:44.088153 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.088103    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjsjf" event={"ID":"cd71dd77-9b8b-4e7c-808a-66f8403e3dab","Type":"ContainerStarted","Data":"50f83d93901fac53907a31c498602e0b7153c8cabd0ef95324602a205064a13a"}
May 27 21:30:44.088371 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.088180    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:44.089373 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.089343    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8b9tz" event={"ID":"8619c2a1-ef70-410d-9b6b-5491ee9974d7","Type":"ContainerStarted","Data":"48d012a6b5a1c13be561fdf72f916302bb2cc0b0acfa5051ffef23b6d65ee0f6"}
May 27 21:30:44.090477 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.090456    2558 generic.go:358] "Generic (PLEG): container finished" podID="fb25b2b7-46f7-447b-86ec-30cbec8d4228" containerID="f70cbb8e0b725040b44c9efc1759a0e220c1f583c66900ecae0a5ade857f9c77" exitCode=1
May 27 21:30:44.090560 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.090505    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" event={"ID":"fb25b2b7-46f7-447b-86ec-30cbec8d4228","Type":"ContainerDied","Data":"f70cbb8e0b725040b44c9efc1759a0e220c1f583c66900ecae0a5ade857f9c77"}
May 27 21:30:44.090793 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.090779    2558 scope.go:117] "RemoveContainer" containerID="f70cbb8e0b725040b44c9efc1759a0e220c1f583c66900ecae0a5ade857f9c77"
May 27 21:30:44.091828 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.091803    2558 generic.go:358] "Generic (PLEG): container finished" podID="4827cbc0-8b56-42b9-9083-5c80904f140e" containerID="532584a4a9c28bb4e584823640cbb138e1d0ba5070b537df2f7ce19f3daf9c09" exitCode=255
May 27 21:30:44.091897 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.091841    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg" event={"ID":"4827cbc0-8b56-42b9-9083-5c80904f140e","Type":"ContainerDied","Data":"532584a4a9c28bb4e584823640cbb138e1d0ba5070b537df2f7ce19f3daf9c09"}
May 27 21:30:44.092165 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.092151    2558 scope.go:117] "RemoveContainer" containerID="532584a4a9c28bb4e584823640cbb138e1d0ba5070b537df2f7ce19f3daf9c09"
May 27 21:30:44.106009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.105957    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vjsjf" podStartSLOduration=130.114344705 podStartE2EDuration="2m12.105942698s" podCreationTimestamp="2026-05-27 21:28:32 +0000 UTC" firstStartedPulling="2026-05-27 21:30:41.564857749 +0000 UTC m=+163.592676936" lastFinishedPulling="2026-05-27 21:30:43.556455735 +0000 UTC m=+165.584274929" observedRunningTime="2026-05-27 21:30:44.105062048 +0000 UTC m=+166.132881257" watchObservedRunningTime="2026-05-27 21:30:44.105942698 +0000 UTC m=+166.133761907"
May 27 21:30:44.158862 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:44.158823    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8b9tz" podStartSLOduration=129.927879024 podStartE2EDuration="2m12.158808787s" podCreationTimestamp="2026-05-27 21:28:32 +0000 UTC" firstStartedPulling="2026-05-27 21:30:41.329753398 +0000 UTC m=+163.357572588" lastFinishedPulling="2026-05-27 21:30:43.560683144 +0000 UTC m=+165.588502351" observedRunningTime="2026-05-27 21:30:44.157960623 +0000 UTC m=+166.185779832" watchObservedRunningTime="2026-05-27 21:30:44.158808787 +0000 UTC m=+166.186628037"
May 27 21:30:45.096717 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:45.096680    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x" event={"ID":"fb25b2b7-46f7-447b-86ec-30cbec8d4228","Type":"ContainerStarted","Data":"deb67d1720dbe3648cdb4768d9c76143b1b7c32ec8e1c8ec05de79738e3a64ad"}
May 27 21:30:45.097139 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:45.096990    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:30:45.097652 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:45.097634    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-657bf869fb-qhh5x"
May 27 21:30:45.098410 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:45.098392    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-59cf55b5db-mc7fg" event={"ID":"4827cbc0-8b56-42b9-9083-5c80904f140e","Type":"ContainerStarted","Data":"63be7ac55ac25dc03441f3827d8b997c50f67e7d8a552a10750ba1c97c8ee2ae"}
May 27 21:30:47.558473 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:47.558396    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:30:54.101255 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:54.101225    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vjsjf"
May 27 21:30:55.098973 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.098946    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kp2b2"]
May 27 21:30:55.103648 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.103633    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.107115 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.106852    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 27 21:30:55.107115 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.107018    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8gwtp\""
May 27 21:30:55.109943 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.107765    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 27 21:30:55.109943 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.108063    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 27 21:30:55.109943 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.108364    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 27 21:30:55.115796 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.115774    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kp2b2"]
May 27 21:30:55.186767 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.186732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6c51d24-7765-402a-be6e-55838f4fbf45-crio-socket\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.186767 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.186768    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vv2b\" (UniqueName: \"kubernetes.io/projected/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-api-access-9vv2b\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.186974 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.186792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c51d24-7765-402a-be6e-55838f4fbf45-data-volume\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.186974 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.186809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6c51d24-7765-402a-be6e-55838f4fbf45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.186974 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.186842    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287775 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287737    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6c51d24-7765-402a-be6e-55838f4fbf45-crio-socket\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287775 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287776    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vv2b\" (UniqueName: \"kubernetes.io/projected/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-api-access-9vv2b\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287853    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6c51d24-7765-402a-be6e-55838f4fbf45-crio-socket\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287895    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c51d24-7765-402a-be6e-55838f4fbf45-data-volume\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287926    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6c51d24-7765-402a-be6e-55838f4fbf45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.287967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.287949    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.288230 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.288211    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6c51d24-7765-402a-be6e-55838f4fbf45-data-volume\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.288522 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.288499    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.290310 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.290292    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6c51d24-7765-402a-be6e-55838f4fbf45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.295605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.295579    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vv2b\" (UniqueName: \"kubernetes.io/projected/a6c51d24-7765-402a-be6e-55838f4fbf45-kube-api-access-9vv2b\") pod \"insights-runtime-extractor-kp2b2\" (UID: \"a6c51d24-7765-402a-be6e-55838f4fbf45\") " pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.414499 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.414394    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kp2b2"
May 27 21:30:55.542415 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:55.542381    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kp2b2"]
May 27 21:30:55.545586 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:30:55.545560    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c51d24_7765_402a_be6e_55838f4fbf45.slice/crio-5df27103a393a14e33f7eae4e7a5ce5259025cf60fd0ccdb1c3e9223f2690be4 WatchSource:0}: Error finding container 5df27103a393a14e33f7eae4e7a5ce5259025cf60fd0ccdb1c3e9223f2690be4: Status 404 returned error can't find the container with id 5df27103a393a14e33f7eae4e7a5ce5259025cf60fd0ccdb1c3e9223f2690be4
May 27 21:30:56.128248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:56.128207    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp2b2" event={"ID":"a6c51d24-7765-402a-be6e-55838f4fbf45","Type":"ContainerStarted","Data":"b6e1efeaf48b7acf44d617908a94bb16dd026e4adc4678045fdc23e32cc4e050"}
May 27 21:30:56.128248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:56.128248    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp2b2" event={"ID":"a6c51d24-7765-402a-be6e-55838f4fbf45","Type":"ContainerStarted","Data":"5df27103a393a14e33f7eae4e7a5ce5259025cf60fd0ccdb1c3e9223f2690be4"}
May 27 21:30:57.132715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:57.132680    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp2b2" event={"ID":"a6c51d24-7765-402a-be6e-55838f4fbf45","Type":"ContainerStarted","Data":"7663bd18e0674aeb5e9e6ffdf134c4973fb7a69d61021ee827a56cd2ae14505d"}
May 27 21:30:59.143186 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:59.143147    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kp2b2" event={"ID":"a6c51d24-7765-402a-be6e-55838f4fbf45","Type":"ContainerStarted","Data":"a8116b758233a965d60c0827f605b9e878668eb6abe24f962e8fd80d6460c0a4"}
May 27 21:30:59.176902 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:30:59.176862    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kp2b2" podStartSLOduration=1.699994148 podStartE2EDuration="4.176848969s" podCreationTimestamp="2026-05-27 21:30:55 +0000 UTC" firstStartedPulling="2026-05-27 21:30:55.599547471 +0000 UTC m=+177.627366664" lastFinishedPulling="2026-05-27 21:30:58.076402297 +0000 UTC m=+180.104221485" observedRunningTime="2026-05-27 21:30:59.176525071 +0000 UTC m=+181.204344280" watchObservedRunningTime="2026-05-27 21:30:59.176848969 +0000 UTC m=+181.204668178"
May 27 21:31:01.180552 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:01.180509    2558 patch_prober.go:28] interesting pod/image-registry-57dfd45b54-4bqmx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 27 21:31:01.180937 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:01.180560    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 27 21:31:03.088948 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:03.088914    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:31:05.635822 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.635780    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dcbs"]
May 27 21:31:05.639241 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.639218    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.641357 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.641336    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 27 21:31:05.641472 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.641356    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2qckr\""
May 27 21:31:05.641512 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.641493    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 27 21:31:05.642278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.642251    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 27 21:31:05.642278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.642255    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 27 21:31:05.642463 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.642285    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 27 21:31:05.642463 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.642351    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 27 21:31:05.765255 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765210    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8kd\" (UniqueName: \"kubernetes.io/projected/05893244-630b-42f6-92c8-d80fb002bec2-kube-api-access-hp8kd\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765255 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-tls\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765337    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-root\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-wtmp\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-textfile\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765604 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-metrics-client-ca\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.765604 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.765543    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-sys\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.866744 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866706    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-metrics-client-ca\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.866744 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866746    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-sys\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866770    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8kd\" (UniqueName: \"kubernetes.io/projected/05893244-630b-42f6-92c8-d80fb002bec2-kube-api-access-hp8kd\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866789    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-tls\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866819    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866832    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-sys\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866972    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-root\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867007 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.866998    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-wtmp\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867021    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-textfile\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867060    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867079    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-root\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867301 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867196    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-wtmp\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867483 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867329    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-textfile\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867483 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867388    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-metrics-client-ca\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.867606 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.867584    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.869342 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.869326    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.869395 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.869383    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05893244-630b-42f6-92c8-d80fb002bec2-node-exporter-tls\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.875427 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.875404    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8kd\" (UniqueName: \"kubernetes.io/projected/05893244-630b-42f6-92c8-d80fb002bec2-kube-api-access-hp8kd\") pod \"node-exporter-8dcbs\" (UID: \"05893244-630b-42f6-92c8-d80fb002bec2\") " pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.947685 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:05.947657    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dcbs"
May 27 21:31:05.955650 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:31:05.955605    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05893244_630b_42f6_92c8_d80fb002bec2.slice/crio-acb7ca4bc2913b34b15e8262d6d4506198d2ec8ce91f216e817c63d4b97958ca WatchSource:0}: Error finding container acb7ca4bc2913b34b15e8262d6d4506198d2ec8ce91f216e817c63d4b97958ca: Status 404 returned error can't find the container with id acb7ca4bc2913b34b15e8262d6d4506198d2ec8ce91f216e817c63d4b97958ca
May 27 21:31:06.162094 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:06.162057    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dcbs" event={"ID":"05893244-630b-42f6-92c8-d80fb002bec2","Type":"ContainerStarted","Data":"acb7ca4bc2913b34b15e8262d6d4506198d2ec8ce91f216e817c63d4b97958ca"}
May 27 21:31:07.166439 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:07.166344    2558 generic.go:358] "Generic (PLEG): container finished" podID="05893244-630b-42f6-92c8-d80fb002bec2" containerID="1acf6f98e77521249f87e680bd4fe00aca8c9dcda86ff3d2381a2f26a7879b6a" exitCode=0
May 27 21:31:07.166439 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:07.166404    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dcbs" event={"ID":"05893244-630b-42f6-92c8-d80fb002bec2","Type":"ContainerDied","Data":"1acf6f98e77521249f87e680bd4fe00aca8c9dcda86ff3d2381a2f26a7879b6a"}
May 27 21:31:08.171433 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:08.171387    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dcbs" event={"ID":"05893244-630b-42f6-92c8-d80fb002bec2","Type":"ContainerStarted","Data":"c52320a707351b2e76d27287cc4a538aea4a26b139797f57f9b560af7279fb87"}
May 27 21:31:08.171433 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:08.171433    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dcbs" event={"ID":"05893244-630b-42f6-92c8-d80fb002bec2","Type":"ContainerStarted","Data":"a738a2618d179a06c1f2f342125878e89ac158e9835262abbf551e920e5768f9"}
May 27 21:31:08.200595 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:08.200552    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dcbs" podStartSLOduration=2.306823148 podStartE2EDuration="3.200536469s" podCreationTimestamp="2026-05-27 21:31:05 +0000 UTC" firstStartedPulling="2026-05-27 21:31:05.95728505 +0000 UTC m=+187.985104238" lastFinishedPulling="2026-05-27 21:31:06.850998366 +0000 UTC m=+188.878817559" observedRunningTime="2026-05-27 21:31:08.199502003 +0000 UTC m=+190.227321224" watchObservedRunningTime="2026-05-27 21:31:08.200536469 +0000 UTC m=+190.228355679"
May 27 21:31:17.656110 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:17.656076    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:31:23.204341 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:23.204303    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" podUID="c861d8f4-f37e-45aa-8ea1-90eb67791059" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 21:31:33.203441 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:33.203399    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" podUID="c861d8f4-f37e-45aa-8ea1-90eb67791059" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 21:31:34.554469 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:34.554442    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/init-textfile/0.log"
May 27 21:31:34.755279 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:34.755244    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/node-exporter/0.log"
May 27 21:31:34.954065 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:34.954041    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/kube-rbac-proxy/0.log"
May 27 21:31:41.553591 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:41.553563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8b9tz_8619c2a1-ef70-410d-9b6b-5491ee9974d7/serve-healthcheck-canary/0.log"
May 27 21:31:42.675603 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:42.675513    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerName="registry" containerID="cri-o://83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083" gracePeriod=30
May 27 21:31:42.933401 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:42.933381    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:31:43.071602 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071566    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.071602 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071604    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.071885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071647    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.071885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071761    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.071885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071810    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.071885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071844    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.072073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071898    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbks4\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.072073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071934    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets\") pod \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\" (UID: \"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec\") "
May 27 21:31:43.072073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.071989    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 21:31:43.072073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.072044    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 21:31:43.072278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.072175    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-certificates\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.072278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.072195    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-trusted-ca\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.074271 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.074237    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 21:31:43.074818 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.074792    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:31:43.074818 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.074799    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4" (OuterVolumeSpecName: "kube-api-access-cbks4") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "kube-api-access-cbks4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:31:43.074967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.074903    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 21:31:43.074967 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.074928    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:31:43.084656 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.084601    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" (UID: "ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 21:31:43.172637 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.172582    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbks4\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-kube-api-access-cbks4\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.172878 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.172860    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-installation-pull-secrets\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.172980 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.172967    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-bound-sa-token\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.173078 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.173064    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-image-registry-private-configuration\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.173174 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.173161    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-registry-tls\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.173258 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.173247    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec-ca-trust-extracted\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:31:43.204447 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.204379    2558 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" podUID="c861d8f4-f37e-45aa-8ea1-90eb67791059" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 27 21:31:43.204447 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.204444    2558 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj"
May 27 21:31:43.204938 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.204911    2558 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"570aa16635123d724db6e7b73239e980f6724e832b49db0e7fc3ad5a1d29ffac"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 27 21:31:43.204990 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.204959    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" podUID="c861d8f4-f37e-45aa-8ea1-90eb67791059" containerName="service-proxy" containerID="cri-o://570aa16635123d724db6e7b73239e980f6724e832b49db0e7fc3ad5a1d29ffac" gracePeriod=30
May 27 21:31:43.260316 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.260285    2558 generic.go:358] "Generic (PLEG): container finished" podID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerID="83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083" exitCode=0
May 27 21:31:43.260466 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.260325    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" event={"ID":"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec","Type":"ContainerDied","Data":"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"}
May 27 21:31:43.260466 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.260353    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx" event={"ID":"ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec","Type":"ContainerDied","Data":"abc33f87ee831e6b7fc9479471bcc08b3bfaf6bb37d27cf573f09d9acd3e4e09"}
May 27 21:31:43.260466 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.260361    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57dfd45b54-4bqmx"
May 27 21:31:43.260582 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.260369    2558 scope.go:117] "RemoveContainer" containerID="83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"
May 27 21:31:43.282329 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.282307    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:31:43.286665 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.286640    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57dfd45b54-4bqmx"]
May 27 21:31:43.316912 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.316886    2558 scope.go:117] "RemoveContainer" containerID="83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"
May 27 21:31:43.317263 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:31:43.317241    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083\": container with ID starting with 83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083 not found: ID does not exist" containerID="83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"
May 27 21:31:43.317370 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:43.317275    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083"} err="failed to get container status \"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083\": rpc error: code = NotFound desc = could not find container \"83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083\": container with ID starting with 83af36a728e77a4f6031534dbd408bcd3c1b71aaa5adfe5b6f9c1b509915a083 not found: ID does not exist"
May 27 21:31:44.264169 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:44.264134    2558 generic.go:358] "Generic (PLEG): container finished" podID="c861d8f4-f37e-45aa-8ea1-90eb67791059" containerID="570aa16635123d724db6e7b73239e980f6724e832b49db0e7fc3ad5a1d29ffac" exitCode=2
May 27 21:31:44.264600 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:44.264204    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerDied","Data":"570aa16635123d724db6e7b73239e980f6724e832b49db0e7fc3ad5a1d29ffac"}
May 27 21:31:44.264600 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:44.264234    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-cc7d4b5bf-7w5fj" event={"ID":"c861d8f4-f37e-45aa-8ea1-90eb67791059","Type":"ContainerStarted","Data":"69c7bd42336de2919ccfb2ed1200e15767075d161374fbb8cd39b0d4bdaaf7b3"}
May 27 21:31:44.562002 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:31:44.561924    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" path="/var/lib/kubelet/pods/ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec/volumes"
May 27 21:32:10.476169 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:10.476116    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:32:10.478784 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:10.478754    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e37582f-501f-48e0-ace0-4f5640789b07-metrics-certs\") pod \"network-metrics-daemon-2vqzh\" (UID: \"0e37582f-501f-48e0-ace0-4f5640789b07\") " pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:32:10.662095 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:10.662061    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qdzf7\""
May 27 21:32:10.670116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:10.670099    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2vqzh"
May 27 21:32:10.796941 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:10.796910    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2vqzh"]
May 27 21:32:10.800168 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:32:10.800138    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e37582f_501f_48e0_ace0_4f5640789b07.slice/crio-a2d8bee02e322180e88a3161af7d3ec02b53507a291526d74534b6db26ce2835 WatchSource:0}: Error finding container a2d8bee02e322180e88a3161af7d3ec02b53507a291526d74534b6db26ce2835: Status 404 returned error can't find the container with id a2d8bee02e322180e88a3161af7d3ec02b53507a291526d74534b6db26ce2835
May 27 21:32:11.338139 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:11.338104    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vqzh" event={"ID":"0e37582f-501f-48e0-ace0-4f5640789b07","Type":"ContainerStarted","Data":"a2d8bee02e322180e88a3161af7d3ec02b53507a291526d74534b6db26ce2835"}
May 27 21:32:12.345198 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:12.345166    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vqzh" event={"ID":"0e37582f-501f-48e0-ace0-4f5640789b07","Type":"ContainerStarted","Data":"fcc89184f5fc20dfbbd864da405d7af8cfe2bd2fc86c44012c946ca6230e1b20"}
May 27 21:32:12.345198 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:12.345201    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2vqzh" event={"ID":"0e37582f-501f-48e0-ace0-4f5640789b07","Type":"ContainerStarted","Data":"fe7a02c1ef3fb40955385839ef917a00b201359f76da997b44e2391e28b7fb39"}
May 27 21:32:12.362758 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:12.362707    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2vqzh" podStartSLOduration=253.269932166 podStartE2EDuration="4m14.362691505s" podCreationTimestamp="2026-05-27 21:27:58 +0000 UTC" firstStartedPulling="2026-05-27 21:32:10.802255628 +0000 UTC m=+252.830074830" lastFinishedPulling="2026-05-27 21:32:11.895014982 +0000 UTC m=+253.922834169" observedRunningTime="2026-05-27 21:32:12.362539604 +0000 UTC m=+254.390358817" watchObservedRunningTime="2026-05-27 21:32:12.362691505 +0000 UTC m=+254.390510714"
May 27 21:32:39.066320 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:32:39.066191    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk" podUID="6501eee3-044c-4f2a-98b1-fbcb73685ada"
May 27 21:32:39.415364 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:39.415287    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:32:42.916482 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:42.916426    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:32:42.919025 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:42.919001    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6501eee3-044c-4f2a-98b1-fbcb73685ada-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-z6nkk\" (UID: \"6501eee3-044c-4f2a-98b1-fbcb73685ada\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:32:43.018837 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:43.018806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-pggqj\""
May 27 21:32:43.026976 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:43.026946    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"
May 27 21:32:43.156409 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:43.156337    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk"]
May 27 21:32:43.160897 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:32:43.160869    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6501eee3_044c_4f2a_98b1_fbcb73685ada.slice/crio-4cf7b5164df499c9fd878caf236d673eda4b6885439363cc73fb4ee47013e242 WatchSource:0}: Error finding container 4cf7b5164df499c9fd878caf236d673eda4b6885439363cc73fb4ee47013e242: Status 404 returned error can't find the container with id 4cf7b5164df499c9fd878caf236d673eda4b6885439363cc73fb4ee47013e242
May 27 21:32:43.425635 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:43.425577    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk" event={"ID":"6501eee3-044c-4f2a-98b1-fbcb73685ada","Type":"ContainerStarted","Data":"4cf7b5164df499c9fd878caf236d673eda4b6885439363cc73fb4ee47013e242"}
May 27 21:32:45.431085 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:45.431053    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk" event={"ID":"6501eee3-044c-4f2a-98b1-fbcb73685ada","Type":"ContainerStarted","Data":"ca4077f2abfc32a43f9af40de17de1508d4c742715ee4c8129091161b7e0ed1d"}
May 27 21:32:45.451795 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:45.451742    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-z6nkk" podStartSLOduration=278.187246793 podStartE2EDuration="4m39.451727749s" podCreationTimestamp="2026-05-27 21:28:06 +0000 UTC" firstStartedPulling="2026-05-27 21:32:43.162799771 +0000 UTC m=+285.190618959" lastFinishedPulling="2026-05-27 21:32:44.427280729 +0000 UTC m=+286.455099915" observedRunningTime="2026-05-27 21:32:45.450791118 +0000 UTC m=+287.478610327" watchObservedRunningTime="2026-05-27 21:32:45.451727749 +0000 UTC m=+287.479546957"
May 27 21:32:58.503826 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:32:58.503800    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 27 21:36:53.543576 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.543493    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"]
May 27 21:36:53.544084 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.543745    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerName="registry"
May 27 21:36:53.544084 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.543760    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerName="registry"
May 27 21:36:53.544084 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.543831    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddd470e7-0e58-4b3a-bb9a-473c6d7d56ec" containerName="registry"
May 27 21:36:53.546650 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.546609    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.552353 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.552330    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qw4lp\""
May 27 21:36:53.552541 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.552525    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 27 21:36:53.552678 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.552663    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 27 21:36:53.553315 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.553255    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 27 21:36:53.553439 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.553323    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 27 21:36:53.557976 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.557958    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 27 21:36:53.573253 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.573221    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"]
May 27 21:36:53.666605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.666572    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fr9d\" (UniqueName: \"kubernetes.io/projected/0f525b13-e8ae-4992-90e0-42266a527aa0-kube-api-access-8fr9d\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.666605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.666608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.666844 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.666689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f525b13-e8ae-4992-90e0-42266a527aa0-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.666844 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.666733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.767917 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.767886    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.768060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.767940    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8fr9d\" (UniqueName: \"kubernetes.io/projected/0f525b13-e8ae-4992-90e0-42266a527aa0-kube-api-access-8fr9d\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.768060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.767967    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.768060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.768009    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f525b13-e8ae-4992-90e0-42266a527aa0-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.768690 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.768669    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f525b13-e8ae-4992-90e0-42266a527aa0-manager-config\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.770548 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.770526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.770647 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.770551    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f525b13-e8ae-4992-90e0-42266a527aa0-metrics-cert\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.783572 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.783549    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fr9d\" (UniqueName: \"kubernetes.io/projected/0f525b13-e8ae-4992-90e0-42266a527aa0-kube-api-access-8fr9d\") pod \"lws-controller-manager-7bff7fcbc9-vznl8\" (UID: \"0f525b13-e8ae-4992-90e0-42266a527aa0\") " pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:53.855642 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:53.855551    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:54.035085 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.035017    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"]
May 27 21:36:54.037676 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:36:54.037643    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f525b13_e8ae_4992_90e0_42266a527aa0.slice/crio-f549fd4ce39140adedc642a06e9c008968dc01be86e0815d4de417b2ce4f7bec WatchSource:0}: Error finding container f549fd4ce39140adedc642a06e9c008968dc01be86e0815d4de417b2ce4f7bec: Status 404 returned error can't find the container with id f549fd4ce39140adedc642a06e9c008968dc01be86e0815d4de417b2ce4f7bec
May 27 21:36:54.039314 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.039297    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 21:36:54.065346 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.065316    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8" event={"ID":"0f525b13-e8ae-4992-90e0-42266a527aa0","Type":"ContainerStarted","Data":"f549fd4ce39140adedc642a06e9c008968dc01be86e0815d4de417b2ce4f7bec"}
May 27 21:36:54.790270 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.790232    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"]
May 27 21:36:54.793596 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.793576    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:54.796374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.796259    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-898d8\""
May 27 21:36:54.796374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.796282    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 27 21:36:54.796374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.796305    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 27 21:36:54.796374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.796349    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 27 21:36:54.796685 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.796670    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 27 21:36:54.809578 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.809553    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"]
May 27 21:36:54.977712 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.977666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:54.977982 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.977723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:54.977982 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:54.977756    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h46n\" (UniqueName: \"kubernetes.io/projected/3b11e93e-a563-4e49-b809-c73845bc8ba1-kube-api-access-4h46n\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.078996 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.078908    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.078996 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.078967    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.079225 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.079000    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h46n\" (UniqueName: \"kubernetes.io/projected/3b11e93e-a563-4e49-b809-c73845bc8ba1-kube-api-access-4h46n\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.081987 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.081951    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.082110 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.082042    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3b11e93e-a563-4e49-b809-c73845bc8ba1-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.088966 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.088937    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h46n\" (UniqueName: \"kubernetes.io/projected/3b11e93e-a563-4e49-b809-c73845bc8ba1-kube-api-access-4h46n\") pod \"opendatahub-operator-controller-manager-7d799877b9-6672q\" (UID: \"3b11e93e-a563-4e49-b809-c73845bc8ba1\") " pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.106725 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.106699    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:55.293462 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:55.293428    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"]
May 27 21:36:55.296762 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:36:55.296735    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b11e93e_a563_4e49_b809_c73845bc8ba1.slice/crio-846817f5f6b98e023eb2bf3eae211f4b8fc7dc0987efe4ff4a4e856a79421fcd WatchSource:0}: Error finding container 846817f5f6b98e023eb2bf3eae211f4b8fc7dc0987efe4ff4a4e856a79421fcd: Status 404 returned error can't find the container with id 846817f5f6b98e023eb2bf3eae211f4b8fc7dc0987efe4ff4a4e856a79421fcd
May 27 21:36:56.072232 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:56.072182    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q" event={"ID":"3b11e93e-a563-4e49-b809-c73845bc8ba1","Type":"ContainerStarted","Data":"846817f5f6b98e023eb2bf3eae211f4b8fc7dc0987efe4ff4a4e856a79421fcd"}
May 27 21:36:57.077367 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:57.077323    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8" event={"ID":"0f525b13-e8ae-4992-90e0-42266a527aa0","Type":"ContainerStarted","Data":"8d70a91b9d87559790ad958fd8203b0c2c6115af06845ee21d03a68d900fb5a9"}
May 27 21:36:57.077852 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:57.077469    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:36:57.110074 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:57.110023    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8" podStartSLOduration=1.59613732 podStartE2EDuration="4.110006862s" podCreationTimestamp="2026-05-27 21:36:53 +0000 UTC" firstStartedPulling="2026-05-27 21:36:54.039446419 +0000 UTC m=+536.067265610" lastFinishedPulling="2026-05-27 21:36:56.55331595 +0000 UTC m=+538.581135152" observedRunningTime="2026-05-27 21:36:57.10786919 +0000 UTC m=+539.135688401" watchObservedRunningTime="2026-05-27 21:36:57.110006862 +0000 UTC m=+539.137826071"
May 27 21:36:59.085046 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:59.085011    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q" event={"ID":"3b11e93e-a563-4e49-b809-c73845bc8ba1","Type":"ContainerStarted","Data":"d66cc09a58486ac007f877e66717425de470174760c0be577815077e16497136"}
May 27 21:36:59.085493 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:59.085132    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:36:59.112534 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:36:59.112491    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q" podStartSLOduration=1.809437021 podStartE2EDuration="5.112477884s" podCreationTimestamp="2026-05-27 21:36:54 +0000 UTC" firstStartedPulling="2026-05-27 21:36:55.298469804 +0000 UTC m=+537.326288992" lastFinishedPulling="2026-05-27 21:36:58.601510668 +0000 UTC m=+540.629329855" observedRunningTime="2026-05-27 21:36:59.110812542 +0000 UTC m=+541.138631751" watchObservedRunningTime="2026-05-27 21:36:59.112477884 +0000 UTC m=+541.140297093"
May 27 21:37:08.083064 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:08.083031    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7bff7fcbc9-vznl8"
May 27 21:37:10.090126 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:10.090101    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d799877b9-6672q"
May 27 21:37:39.537932 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.537890    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"]
May 27 21:37:39.548241 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.548217    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.551043 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.551019    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 27 21:37:39.551179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.551021    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 27 21:37:39.551179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.551071    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 27 21:37:39.551179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.551109    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6szlw\""
May 27 21:37:39.554009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.553987    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"]
May 27 21:37:39.598389 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598389 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598393    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598422    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598601    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598660    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598682    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.598786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.598699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs2g8\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-kube-api-access-vs2g8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699792 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699760    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699810    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699832    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699855    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699874    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699896    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vs2g8\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-kube-api-access-vs2g8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699929    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.699963 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699946    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.699988    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.700229    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.700262    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700427 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.700309    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700494 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.700474    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.700855 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.700787    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.702534 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.702513    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.702628 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.702559    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.720299 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.720280    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.720386 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.720313    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs2g8\" (UniqueName: \"kubernetes.io/projected/31437f51-bbb8-4ca9-a5b2-87219ad88f9c-kube-api-access-vs2g8\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4blgxp8\" (UID: \"31437f51-bbb8-4ca9-a5b2-87219ad88f9c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.858837 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.858736    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:39.988755 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:39.988722    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"]
May 27 21:37:39.991849 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:37:39.991815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31437f51_bbb8_4ca9_a5b2_87219ad88f9c.slice/crio-25bba38fe48459a1fac76b6640032f7132f55ca1878806e4c8332ba51cdf7bc7 WatchSource:0}: Error finding container 25bba38fe48459a1fac76b6640032f7132f55ca1878806e4c8332ba51cdf7bc7: Status 404 returned error can't find the container with id 25bba38fe48459a1fac76b6640032f7132f55ca1878806e4c8332ba51cdf7bc7
May 27 21:37:40.191082 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:40.191050    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8" event={"ID":"31437f51-bbb8-4ca9-a5b2-87219ad88f9c","Type":"ContainerStarted","Data":"25bba38fe48459a1fac76b6640032f7132f55ca1878806e4c8332ba51cdf7bc7"}
May 27 21:37:42.736889 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:42.736857    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:37:42.737145 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:42.736937    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:37:42.737145 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:42.736972    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:37:43.201037 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:43.200998    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8" event={"ID":"31437f51-bbb8-4ca9-a5b2-87219ad88f9c","Type":"ContainerStarted","Data":"128a9cb7c303d7f04d31b19f5d353d4e66e1713ec31415574cd970620b3db879"}
May 27 21:37:43.224717 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:43.224667    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8" podStartSLOduration=1.481753141 podStartE2EDuration="4.224650344s" podCreationTimestamp="2026-05-27 21:37:39 +0000 UTC" firstStartedPulling="2026-05-27 21:37:39.993724399 +0000 UTC m=+582.021543587" lastFinishedPulling="2026-05-27 21:37:42.736621589 +0000 UTC m=+584.764440790" observedRunningTime="2026-05-27 21:37:43.22241816 +0000 UTC m=+585.250237368" watchObservedRunningTime="2026-05-27 21:37:43.224650344 +0000 UTC m=+585.252469553"
May 27 21:37:43.859203 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:43.859158    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:43.863763 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:43.863736    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:44.204197 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:44.204167    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:37:44.205221 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:37:44.205198    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4blgxp8"
May 27 21:38:13.907406 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.907370    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:13.910537 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.910520    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:13.913215 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.913192    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 27 21:38:13.913343 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.913262    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 27 21:38:13.914092 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.914072    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zdzmx\""
May 27 21:38:13.922409 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:13.922385    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:14.058727 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.055315    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftvgt\" (UniqueName: \"kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt\") pod \"kuadrant-operator-catalog-g4nz4\" (UID: \"3fbe0ac7-76a3-4d9b-ade2-f616773844e6\") " pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:14.156474 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.156426    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftvgt\" (UniqueName: \"kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt\") pod \"kuadrant-operator-catalog-g4nz4\" (UID: \"3fbe0ac7-76a3-4d9b-ade2-f616773844e6\") " pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:14.165245 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.165180    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftvgt\" (UniqueName: \"kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt\") pod \"kuadrant-operator-catalog-g4nz4\" (UID: \"3fbe0ac7-76a3-4d9b-ade2-f616773844e6\") " pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:14.219238 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.219197    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:14.270153 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.270118    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:14.348458 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.348436    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:14.351432 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:38:14.351403    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbe0ac7_76a3_4d9b_ade2_f616773844e6.slice/crio-6c491bb1568863d15e59ffd4abb30931c6075bc3039eeacf7d869b3634fb0546 WatchSource:0}: Error finding container 6c491bb1568863d15e59ffd4abb30931c6075bc3039eeacf7d869b3634fb0546: Status 404 returned error can't find the container with id 6c491bb1568863d15e59ffd4abb30931c6075bc3039eeacf7d869b3634fb0546
May 27 21:38:14.477572 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.477536    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trhsk"]
May 27 21:38:14.481892 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.481874    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:14.489222 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.489196    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trhsk"]
May 27 21:38:14.559211 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.559179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqd87\" (UniqueName: \"kubernetes.io/projected/7df2396c-1f1e-42db-9cfb-5243fcc1092a-kube-api-access-zqd87\") pod \"kuadrant-operator-catalog-trhsk\" (UID: \"7df2396c-1f1e-42db-9cfb-5243fcc1092a\") " pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:14.660252 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.660221    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqd87\" (UniqueName: \"kubernetes.io/projected/7df2396c-1f1e-42db-9cfb-5243fcc1092a-kube-api-access-zqd87\") pod \"kuadrant-operator-catalog-trhsk\" (UID: \"7df2396c-1f1e-42db-9cfb-5243fcc1092a\") " pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:14.669087 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.669061    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqd87\" (UniqueName: \"kubernetes.io/projected/7df2396c-1f1e-42db-9cfb-5243fcc1092a-kube-api-access-zqd87\") pod \"kuadrant-operator-catalog-trhsk\" (UID: \"7df2396c-1f1e-42db-9cfb-5243fcc1092a\") " pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:14.791529 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.791442    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:14.921633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:14.921552    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-trhsk"]
May 27 21:38:14.925421 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:38:14.925397    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df2396c_1f1e_42db_9cfb_5243fcc1092a.slice/crio-e5afc90fa0de3fa251f1b4f9857fa71080709d46fc90f0f802847eda8c71b3b5 WatchSource:0}: Error finding container e5afc90fa0de3fa251f1b4f9857fa71080709d46fc90f0f802847eda8c71b3b5: Status 404 returned error can't find the container with id e5afc90fa0de3fa251f1b4f9857fa71080709d46fc90f0f802847eda8c71b3b5
May 27 21:38:15.285799 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:15.285764    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trhsk" event={"ID":"7df2396c-1f1e-42db-9cfb-5243fcc1092a","Type":"ContainerStarted","Data":"e5afc90fa0de3fa251f1b4f9857fa71080709d46fc90f0f802847eda8c71b3b5"}
May 27 21:38:15.286873 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:15.286836    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" event={"ID":"3fbe0ac7-76a3-4d9b-ade2-f616773844e6","Type":"ContainerStarted","Data":"6c491bb1568863d15e59ffd4abb30931c6075bc3039eeacf7d869b3634fb0546"}
May 27 21:38:17.294035 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.294001    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-trhsk" event={"ID":"7df2396c-1f1e-42db-9cfb-5243fcc1092a","Type":"ContainerStarted","Data":"9d72d202fba76eda9e1c118cc416a1391466e1a159717e8c3b8e36a0c631f3cf"}
May 27 21:38:17.295311 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.295288    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" event={"ID":"3fbe0ac7-76a3-4d9b-ade2-f616773844e6","Type":"ContainerStarted","Data":"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"}
May 27 21:38:17.295441 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.295367    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" podUID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" containerName="registry-server" containerID="cri-o://d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126" gracePeriod=2
May 27 21:38:17.310057 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.310011    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-trhsk" podStartSLOduration=1.593482563 podStartE2EDuration="3.309997812s" podCreationTimestamp="2026-05-27 21:38:14 +0000 UTC" firstStartedPulling="2026-05-27 21:38:14.92679687 +0000 UTC m=+616.954616058" lastFinishedPulling="2026-05-27 21:38:16.643312112 +0000 UTC m=+618.671131307" observedRunningTime="2026-05-27 21:38:17.308949403 +0000 UTC m=+619.336768611" watchObservedRunningTime="2026-05-27 21:38:17.309997812 +0000 UTC m=+619.337817021"
May 27 21:38:17.325312 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.325272    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" podStartSLOduration=2.053020499 podStartE2EDuration="4.325258805s" podCreationTimestamp="2026-05-27 21:38:13 +0000 UTC" firstStartedPulling="2026-05-27 21:38:14.352660285 +0000 UTC m=+616.380479471" lastFinishedPulling="2026-05-27 21:38:16.624898587 +0000 UTC m=+618.652717777" observedRunningTime="2026-05-27 21:38:17.323839412 +0000 UTC m=+619.351658620" watchObservedRunningTime="2026-05-27 21:38:17.325258805 +0000 UTC m=+619.353078013"
May 27 21:38:17.536328 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.536302    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:17.688113 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.688082    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftvgt\" (UniqueName: \"kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt\") pod \"3fbe0ac7-76a3-4d9b-ade2-f616773844e6\" (UID: \"3fbe0ac7-76a3-4d9b-ade2-f616773844e6\") "
May 27 21:38:17.690459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.690424    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt" (OuterVolumeSpecName: "kube-api-access-ftvgt") pod "3fbe0ac7-76a3-4d9b-ade2-f616773844e6" (UID: "3fbe0ac7-76a3-4d9b-ade2-f616773844e6"). InnerVolumeSpecName "kube-api-access-ftvgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:38:17.789082 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:17.789044    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftvgt\" (UniqueName: \"kubernetes.io/projected/3fbe0ac7-76a3-4d9b-ade2-f616773844e6-kube-api-access-ftvgt\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:38:18.298933 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.298894    2558 generic.go:358] "Generic (PLEG): container finished" podID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" containerID="d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126" exitCode=0
May 27 21:38:18.299408 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.298961    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4"
May 27 21:38:18.299408 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.298984    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" event={"ID":"3fbe0ac7-76a3-4d9b-ade2-f616773844e6","Type":"ContainerDied","Data":"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"}
May 27 21:38:18.299408 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.299029    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-g4nz4" event={"ID":"3fbe0ac7-76a3-4d9b-ade2-f616773844e6","Type":"ContainerDied","Data":"6c491bb1568863d15e59ffd4abb30931c6075bc3039eeacf7d869b3634fb0546"}
May 27 21:38:18.299408 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.299055    2558 scope.go:117] "RemoveContainer" containerID="d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"
May 27 21:38:18.306995 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.306976    2558 scope.go:117] "RemoveContainer" containerID="d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"
May 27 21:38:18.307265 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:38:18.307247    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126\": container with ID starting with d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126 not found: ID does not exist" containerID="d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"
May 27 21:38:18.307307 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.307274    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126"} err="failed to get container status \"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126\": rpc error: code = NotFound desc = could not find container \"d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126\": container with ID starting with d79e60a7e4dd7ad2a4901215f429e53f2f4757805102966871b888a92e875126 not found: ID does not exist"
May 27 21:38:18.318401 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.318379    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:18.322455 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.322433    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-g4nz4"]
May 27 21:38:18.565648 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:18.565539    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" path="/var/lib/kubelet/pods/3fbe0ac7-76a3-4d9b-ade2-f616773844e6/volumes"
May 27 21:38:24.792409 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:24.792350    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:24.792854 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:24.792433    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:24.814079 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:24.814055    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:25.339170 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:25.339142    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-trhsk"
May 27 21:38:44.927278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.927241    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"]
May 27 21:38:44.929633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.927515    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" containerName="registry-server"
May 27 21:38:44.929633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.927526    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" containerName="registry-server"
May 27 21:38:44.929633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.927575    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="3fbe0ac7-76a3-4d9b-ade2-f616773844e6" containerName="registry-server"
May 27 21:38:44.930524 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.930509    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:44.934907 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.934886    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hkqtz\""
May 27 21:38:44.944248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.944223    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"]
May 27 21:38:44.982119 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:44.982088    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24x9v\" (UniqueName: \"kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v\") pod \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" (UID: \"82c4d7b6-9ce7-4307-b898-2125fb357da4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:45.083419 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:45.083381    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-24x9v\" (UniqueName: \"kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v\") pod \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" (UID: \"82c4d7b6-9ce7-4307-b898-2125fb357da4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:45.096935 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:45.096909    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24x9v\" (UniqueName: \"kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v\") pod \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" (UID: \"82c4d7b6-9ce7-4307-b898-2125fb357da4\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:45.239779 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:45.239741    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:45.370221 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:45.370182    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"]
May 27 21:38:45.373985 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:38:45.373960    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c4d7b6_9ce7_4307_b898_2125fb357da4.slice/crio-e27559bd2743836cc117ecd35996386b314ca6a9bebcf896cf5407cb5b7ac89b WatchSource:0}: Error finding container e27559bd2743836cc117ecd35996386b314ca6a9bebcf896cf5407cb5b7ac89b: Status 404 returned error can't find the container with id e27559bd2743836cc117ecd35996386b314ca6a9bebcf896cf5407cb5b7ac89b
May 27 21:38:46.377961 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:46.377915    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" event={"ID":"82c4d7b6-9ce7-4307-b898-2125fb357da4","Type":"ContainerStarted","Data":"e27559bd2743836cc117ecd35996386b314ca6a9bebcf896cf5407cb5b7ac89b"}
May 27 21:38:47.382335 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:47.382245    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" event={"ID":"82c4d7b6-9ce7-4307-b898-2125fb357da4","Type":"ContainerStarted","Data":"54ce059f98a003e3217291dc8fe391704032280a93779dcdf8c6a74e89f39807"}
May 27 21:38:47.382705 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:47.382371    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:47.402034 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:47.401987    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" podStartSLOduration=1.757649663 podStartE2EDuration="3.401975779s" podCreationTimestamp="2026-05-27 21:38:44 +0000 UTC" firstStartedPulling="2026-05-27 21:38:45.3758839 +0000 UTC m=+647.403703087" lastFinishedPulling="2026-05-27 21:38:47.020210015 +0000 UTC m=+649.048029203" observedRunningTime="2026-05-27 21:38:47.401731883 +0000 UTC m=+649.429551093" watchObservedRunningTime="2026-05-27 21:38:47.401975779 +0000 UTC m=+649.429794988"
May 27 21:38:52.805363 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.805330    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"]
May 27 21:38:52.808359 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.808343    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:52.814469 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.814403    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 27 21:38:52.814876 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.814860    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bpx8q\""
May 27 21:38:52.833351 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.833323    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"]
May 27 21:38:52.841249 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.841224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvhn\" (UniqueName: \"kubernetes.io/projected/38c320f9-5946-4068-be83-d6dde0801d32-kube-api-access-lcvhn\") pod \"dns-operator-controller-manager-648d5c98bc-pqsqm\" (UID: \"38c320f9-5946-4068-be83-d6dde0801d32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:52.942542 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.942505    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvhn\" (UniqueName: \"kubernetes.io/projected/38c320f9-5946-4068-be83-d6dde0801d32-kube-api-access-lcvhn\") pod \"dns-operator-controller-manager-648d5c98bc-pqsqm\" (UID: \"38c320f9-5946-4068-be83-d6dde0801d32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:52.957982 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:52.957948    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvhn\" (UniqueName: \"kubernetes.io/projected/38c320f9-5946-4068-be83-d6dde0801d32-kube-api-access-lcvhn\") pod \"dns-operator-controller-manager-648d5c98bc-pqsqm\" (UID: \"38c320f9-5946-4068-be83-d6dde0801d32\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:53.118318 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:53.118219    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:53.247016 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:53.246904    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"]
May 27 21:38:53.249711 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:38:53.249676    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c320f9_5946_4068_be83_d6dde0801d32.slice/crio-c8386c0efc2cb02257eda875c5984f2d50e92e9b1b94cf58a5a2a1d3c66c69e4 WatchSource:0}: Error finding container c8386c0efc2cb02257eda875c5984f2d50e92e9b1b94cf58a5a2a1d3c66c69e4: Status 404 returned error can't find the container with id c8386c0efc2cb02257eda875c5984f2d50e92e9b1b94cf58a5a2a1d3c66c69e4
May 27 21:38:53.402041 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:53.401952    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm" event={"ID":"38c320f9-5946-4068-be83-d6dde0801d32","Type":"ContainerStarted","Data":"c8386c0efc2cb02257eda875c5984f2d50e92e9b1b94cf58a5a2a1d3c66c69e4"}
May 27 21:38:56.413890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:56.413855    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm" event={"ID":"38c320f9-5946-4068-be83-d6dde0801d32","Type":"ContainerStarted","Data":"b2ecd1aa44bb7ad3648fcfa53388878ea1ff812b2cb7cafb2d45c84e3258948e"}
May 27 21:38:56.414278 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:56.413906    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:38:56.450787 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:56.450741    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm" podStartSLOduration=2.273971687 podStartE2EDuration="4.450726015s" podCreationTimestamp="2026-05-27 21:38:52 +0000 UTC" firstStartedPulling="2026-05-27 21:38:53.251976418 +0000 UTC m=+655.279795619" lastFinishedPulling="2026-05-27 21:38:55.428730742 +0000 UTC m=+657.456549947" observedRunningTime="2026-05-27 21:38:56.448975462 +0000 UTC m=+658.476794684" watchObservedRunningTime="2026-05-27 21:38:56.450726015 +0000 UTC m=+658.478545223"
May 27 21:38:57.554137 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.554103    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"]
May 27 21:38:57.560454 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.560418    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.564379 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.564356    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wcbq\""
May 27 21:38:57.579411 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.579384    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldd86\" (UniqueName: \"kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.579516 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.579421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.584018 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.583993    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"]
May 27 21:38:57.680425 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.680385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.680596 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.680484    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ldd86\" (UniqueName: \"kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.680914 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.680895    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.692287 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.692263    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldd86\" (UniqueName: \"kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:57.870275 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:57.870181    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:38:58.004838 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:58.004811    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"]
May 27 21:38:58.007470 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:38:58.007440    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37a30c0_4e6c_4850_859b_52e61818fde2.slice/crio-5501b916d0ee2db2eb024508157e8b8780317f78aff60d1699c4fa7748771595 WatchSource:0}: Error finding container 5501b916d0ee2db2eb024508157e8b8780317f78aff60d1699c4fa7748771595: Status 404 returned error can't find the container with id 5501b916d0ee2db2eb024508157e8b8780317f78aff60d1699c4fa7748771595
May 27 21:38:58.388808 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:58.388777    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:38:58.421817 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:38:58.421780    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" event={"ID":"a37a30c0-4e6c-4850-859b-52e61818fde2","Type":"ContainerStarted","Data":"5501b916d0ee2db2eb024508157e8b8780317f78aff60d1699c4fa7748771595"}
May 27 21:38:58.504852 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:38:58.504815    2558 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df2396c_1f1e_42db_9cfb_5243fcc1092a.slice/crio-e5afc90fa0de3fa251f1b4f9857fa71080709d46fc90f0f802847eda8c71b3b5\": RecentStats: unable to find data in memory cache]"
May 27 21:39:03.439554 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:03.439517    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" event={"ID":"a37a30c0-4e6c-4850-859b-52e61818fde2","Type":"ContainerStarted","Data":"0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3"}
May 27 21:39:03.439959 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:03.439646    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:39:03.470605 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:03.470542    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" podStartSLOduration=1.904783899 podStartE2EDuration="6.470525834s" podCreationTimestamp="2026-05-27 21:38:57 +0000 UTC" firstStartedPulling="2026-05-27 21:38:58.009688749 +0000 UTC m=+660.037507937" lastFinishedPulling="2026-05-27 21:39:02.57543067 +0000 UTC m=+664.603249872" observedRunningTime="2026-05-27 21:39:03.469999664 +0000 UTC m=+665.497818872" watchObservedRunningTime="2026-05-27 21:39:03.470525834 +0000 UTC m=+665.498345043"
May 27 21:39:07.419538 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:07.419510    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-pqsqm"
May 27 21:39:14.445454 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:14.445422    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:39:16.155444 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.155410    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"]
May 27 21:39:16.156060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.155645    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" containerName="manager" containerID="cri-o://0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3" gracePeriod=2
May 27 21:39:16.171039 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.171010    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"]
May 27 21:39:16.192177 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.192136    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:39:16.192794 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.192772    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" containerName="manager"
May 27 21:39:16.192918 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.192800    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" containerName="manager"
May 27 21:39:16.192918 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.192915    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" containerName="manager"
May 27 21:39:16.196469 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.196445    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:16.196606 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.196590    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.199550 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.199532    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.235316 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.235289    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:39:16.243317 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.243291    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"]
May 27 21:39:16.243520 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.243500    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" containerName="manager" containerID="cri-o://54ce059f98a003e3217291dc8fe391704032280a93779dcdf8c6a74e89f39807" gracePeriod=2
May 27 21:39:16.245951 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.245917    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:16.266973 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.266944    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"]
May 27 21:39:16.342208 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.342175    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.342412 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.342222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.342412 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.342250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnc2j\" (UniqueName: \"kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.342412 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.342309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbr7k\" (UniqueName: \"kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.442819 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.442788    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.442973 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.442831    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.442973 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.442866    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnc2j\" (UniqueName: \"kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.442973 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.442905    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbr7k\" (UniqueName: \"kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.443279 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.443257    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.443332 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.443257    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.452748 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.452725    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbr7k\" (UniqueName: \"kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-4dmdw\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.452988 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.452966    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnc2j\" (UniqueName: \"kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8thdg\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.474919 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.474899    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:39:16.477271 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.477246    2558 status_manager.go:895] "Failed to get status for pod" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" err="pods \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.477872 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.477847    2558 generic.go:358] "Generic (PLEG): container finished" podID="82c4d7b6-9ce7-4307-b898-2125fb357da4" containerID="54ce059f98a003e3217291dc8fe391704032280a93779dcdf8c6a74e89f39807" exitCode=0
May 27 21:39:16.477970 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.477861    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:39:16.477970 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.477924    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e27559bd2743836cc117ecd35996386b314ca6a9bebcf896cf5407cb5b7ac89b"
May 27 21:39:16.478942 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.478921    2558 generic.go:358] "Generic (PLEG): container finished" podID="a37a30c0-4e6c-4850-859b-52e61818fde2" containerID="0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3" exitCode=0
May 27 21:39:16.479025 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.478959    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw"
May 27 21:39:16.479025 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.478992    2558 scope.go:117] "RemoveContainer" containerID="0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3"
May 27 21:39:16.479025 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.479011    2558 status_manager.go:895] "Failed to get status for pod" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.480824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.480803    2558 status_manager.go:895] "Failed to get status for pod" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" err="pods \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.484181 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.484154    2558 status_manager.go:895] "Failed to get status for pod" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.485786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.485765    2558 status_manager.go:895] "Failed to get status for pod" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf" err="pods \"limitador-operator-controller-manager-85c4996f8c-mc7hf\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.486374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.486361    2558 scope.go:117] "RemoveContainer" containerID="0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3"
May 27 21:39:16.486605 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:39:16.486589    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3\": container with ID starting with 0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3 not found: ID does not exist" containerID="0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3"
May 27 21:39:16.486667 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.486628    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3"} err="failed to get container status \"0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3\": rpc error: code = NotFound desc = could not find container \"0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3\": container with ID starting with 0e6e7db11947df4d000f0cada1a1fa91ae72060feeb613ffe9b8864f03ee33c3 not found: ID does not exist"
May 27 21:39:16.487442 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.487423    2558 status_manager.go:895] "Failed to get status for pod" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b5qkw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b5qkw\" is forbidden: User \"system:node:ip-10-0-138-159.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-159.ec2.internal' and this object"
May 27 21:39:16.544227 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.544191    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume\") pod \"a37a30c0-4e6c-4850-859b-52e61818fde2\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") "
May 27 21:39:16.544393 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.544268    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24x9v\" (UniqueName: \"kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v\") pod \"82c4d7b6-9ce7-4307-b898-2125fb357da4\" (UID: \"82c4d7b6-9ce7-4307-b898-2125fb357da4\") "
May 27 21:39:16.544393 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.544321    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldd86\" (UniqueName: \"kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86\") pod \"a37a30c0-4e6c-4850-859b-52e61818fde2\" (UID: \"a37a30c0-4e6c-4850-859b-52e61818fde2\") "
May 27 21:39:16.544774 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.544749    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a37a30c0-4e6c-4850-859b-52e61818fde2" (UID: "a37a30c0-4e6c-4850-859b-52e61818fde2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 21:39:16.546543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.546518    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v" (OuterVolumeSpecName: "kube-api-access-24x9v") pod "82c4d7b6-9ce7-4307-b898-2125fb357da4" (UID: "82c4d7b6-9ce7-4307-b898-2125fb357da4"). InnerVolumeSpecName "kube-api-access-24x9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:39:16.546543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.546527    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86" (OuterVolumeSpecName: "kube-api-access-ldd86") pod "a37a30c0-4e6c-4850-859b-52e61818fde2" (UID: "a37a30c0-4e6c-4850-859b-52e61818fde2"). InnerVolumeSpecName "kube-api-access-ldd86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:39:16.553716 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.553699    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:16.562556 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.562535    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" path="/var/lib/kubelet/pods/82c4d7b6-9ce7-4307-b898-2125fb357da4/volumes"
May 27 21:39:16.562894 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.562881    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a37a30c0-4e6c-4850-859b-52e61818fde2" path="/var/lib/kubelet/pods/a37a30c0-4e6c-4850-859b-52e61818fde2/volumes"
May 27 21:39:16.612043 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.611921    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:16.646207 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.645540    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldd86\" (UniqueName: \"kubernetes.io/projected/a37a30c0-4e6c-4850-859b-52e61818fde2-kube-api-access-ldd86\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:16.646207 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.645572    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a37a30c0-4e6c-4850-859b-52e61818fde2-extensions-socket-volume\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:16.646207 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.645585    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24x9v\" (UniqueName: \"kubernetes.io/projected/82c4d7b6-9ce7-4307-b898-2125fb357da4-kube-api-access-24x9v\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:16.710883 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.710853    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:39:16.716843 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:39:16.716805    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5d30c6_5a97_4bdf_8290_732fc4d7e503.slice/crio-088f918f283350f99d3fe02ca786b3d956a2461a42191d228ac55a0a1610a974 WatchSource:0}: Error finding container 088f918f283350f99d3fe02ca786b3d956a2461a42191d228ac55a0a1610a974: Status 404 returned error can't find the container with id 088f918f283350f99d3fe02ca786b3d956a2461a42191d228ac55a0a1610a974
May 27 21:39:16.764586 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:16.764526    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:16.767402 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:39:16.767366    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod014fcc23_3067_4c31_a7d9_e0b6de96f236.slice/crio-c16adb40d526190b3663b9172445fcbb8e8ce647cc6e38e3d844b7b361d1fe71 WatchSource:0}: Error finding container c16adb40d526190b3663b9172445fcbb8e8ce647cc6e38e3d844b7b361d1fe71: Status 404 returned error can't find the container with id c16adb40d526190b3663b9172445fcbb8e8ce647cc6e38e3d844b7b361d1fe71
May 27 21:39:17.483819 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.483783    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" event={"ID":"014fcc23-3067-4c31-a7d9-e0b6de96f236","Type":"ContainerStarted","Data":"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"}
May 27 21:39:17.483819 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.483819    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" event={"ID":"014fcc23-3067-4c31-a7d9-e0b6de96f236","Type":"ContainerStarted","Data":"c16adb40d526190b3663b9172445fcbb8e8ce647cc6e38e3d844b7b361d1fe71"}
May 27 21:39:17.484295 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.483871    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:17.485253 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.485234    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-mc7hf"
May 27 21:39:17.485309 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.485258    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" event={"ID":"aa5d30c6-5a97-4bdf-8290-732fc4d7e503","Type":"ContainerStarted","Data":"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"}
May 27 21:39:17.485309 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.485282    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" event={"ID":"aa5d30c6-5a97-4bdf-8290-732fc4d7e503","Type":"ContainerStarted","Data":"088f918f283350f99d3fe02ca786b3d956a2461a42191d228ac55a0a1610a974"}
May 27 21:39:17.485385 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.485313    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:17.520180 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.520132    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" podStartSLOduration=1.5201181799999999 podStartE2EDuration="1.52011818s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:17.518470464 +0000 UTC m=+679.546289672" watchObservedRunningTime="2026-05-27 21:39:17.52011818 +0000 UTC m=+679.547937389"
May 27 21:39:17.549352 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:17.549301    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" podStartSLOduration=1.549284642 podStartE2EDuration="1.549284642s" podCreationTimestamp="2026-05-27 21:39:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:17.547817418 +0000 UTC m=+679.575636626" watchObservedRunningTime="2026-05-27 21:39:17.549284642 +0000 UTC m=+679.577103851"
May 27 21:39:28.490293 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.490255    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:28.490779 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.490336    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:39:28.571837 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.571806    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:28.572038 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.572012    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" podUID="014fcc23-3067-4c31-a7d9-e0b6de96f236" containerName="manager" containerID="cri-o://94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513" gracePeriod=10
May 27 21:39:28.815624 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.815581    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:28.945332 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.945297    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbr7k\" (UniqueName: \"kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k\") pod \"014fcc23-3067-4c31-a7d9-e0b6de96f236\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") "
May 27 21:39:28.945492 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.945350    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume\") pod \"014fcc23-3067-4c31-a7d9-e0b6de96f236\" (UID: \"014fcc23-3067-4c31-a7d9-e0b6de96f236\") "
May 27 21:39:28.945769 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.945741    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "014fcc23-3067-4c31-a7d9-e0b6de96f236" (UID: "014fcc23-3067-4c31-a7d9-e0b6de96f236"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 21:39:28.947527 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:28.947496    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k" (OuterVolumeSpecName: "kube-api-access-cbr7k") pod "014fcc23-3067-4c31-a7d9-e0b6de96f236" (UID: "014fcc23-3067-4c31-a7d9-e0b6de96f236"). InnerVolumeSpecName "kube-api-access-cbr7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:39:29.045920 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.045829    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbr7k\" (UniqueName: \"kubernetes.io/projected/014fcc23-3067-4c31-a7d9-e0b6de96f236-kube-api-access-cbr7k\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:29.045920 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.045860    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/014fcc23-3067-4c31-a7d9-e0b6de96f236-extensions-socket-volume\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:29.522019 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.521981    2558 generic.go:358] "Generic (PLEG): container finished" podID="014fcc23-3067-4c31-a7d9-e0b6de96f236" containerID="94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513" exitCode=0
May 27 21:39:29.522472 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.522041    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"
May 27 21:39:29.522472 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.522045    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" event={"ID":"014fcc23-3067-4c31-a7d9-e0b6de96f236","Type":"ContainerDied","Data":"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"}
May 27 21:39:29.522472 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.522159    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw" event={"ID":"014fcc23-3067-4c31-a7d9-e0b6de96f236","Type":"ContainerDied","Data":"c16adb40d526190b3663b9172445fcbb8e8ce647cc6e38e3d844b7b361d1fe71"}
May 27 21:39:29.522472 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.522182    2558 scope.go:117] "RemoveContainer" containerID="94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"
May 27 21:39:29.530147 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.530126    2558 scope.go:117] "RemoveContainer" containerID="94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"
May 27 21:39:29.530383 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:39:29.530366    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513\": container with ID starting with 94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513 not found: ID does not exist" containerID="94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"
May 27 21:39:29.530432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.530393    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513"} err="failed to get container status \"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513\": rpc error: code = NotFound desc = could not find container \"94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513\": container with ID starting with 94d9bd0235b019a792d4765f2088e4c7fb9bcc23b2eb555018037a5b56ee3513 not found: ID does not exist"
May 27 21:39:29.544926 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.544894    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:29.548952 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:29.548930    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-4dmdw"]
May 27 21:39:30.562066 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:30.562032    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="014fcc23-3067-4c31-a7d9-e0b6de96f236" path="/var/lib/kubelet/pods/014fcc23-3067-4c31-a7d9-e0b6de96f236/volumes"
May 27 21:39:44.878695 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.878658    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"]
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879057    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="014fcc23-3067-4c31-a7d9-e0b6de96f236" containerName="manager"
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879073    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="014fcc23-3067-4c31-a7d9-e0b6de96f236" containerName="manager"
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879081    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" containerName="manager"
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879088    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" containerName="manager"
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879144    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="82c4d7b6-9ce7-4307-b898-2125fb357da4" containerName="manager"
May 27 21:39:44.879224 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.879162    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="014fcc23-3067-4c31-a7d9-e0b6de96f236" containerName="manager"
May 27 21:39:44.884060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.884037    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.886867 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.886843    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xg77z\""
May 27 21:39:44.896337 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.896311    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"]
May 27 21:39:44.967356 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967320    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967356 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967375    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967475    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5lb\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-kube-api-access-mc5lb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967502    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967529    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967730 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967565    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:44.967730 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:44.967599    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068659 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068600    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068682    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068713    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068749    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068789    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.068824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068815    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069057 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068843    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069057 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.068873    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069157 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069127    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069216 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069158    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069216 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069182    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069323 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5lb\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-kube-api-access-mc5lb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069422 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069399    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.069794 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.069768    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.071221 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.071199    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.071339 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.071323    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.081713 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.081693    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5lb\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-kube-api-access-mc5lb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.083110 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.083090    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5b6e51d-643d-47d4-bd4d-09cbba998fe4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-jvclc\" (UID: \"a5b6e51d-643d-47d4-bd4d-09cbba998fe4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.196668 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.196642    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:45.342567 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.342532    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"]
May 27 21:39:45.344287 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:39:45.344245    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5b6e51d_643d_47d4_bd4d_09cbba998fe4.slice/crio-9480344dc0e03344c54f191a2d1f154fc6f545040b54c25ea790074f0e89caeb WatchSource:0}: Error finding container 9480344dc0e03344c54f191a2d1f154fc6f545040b54c25ea790074f0e89caeb: Status 404 returned error can't find the container with id 9480344dc0e03344c54f191a2d1f154fc6f545040b54c25ea790074f0e89caeb
May 27 21:39:45.346291 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.346261    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:39:45.346371 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.346320    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:39:45.346371 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.346347    2558 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
May 27 21:39:45.589871 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.589775    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc" event={"ID":"a5b6e51d-643d-47d4-bd4d-09cbba998fe4","Type":"ContainerStarted","Data":"59317d5cd53982da8dc947cb102f52b9fabce802a00f4caf24342783e2b3d97b"}
May 27 21:39:45.589871 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.589813    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc" event={"ID":"a5b6e51d-643d-47d4-bd4d-09cbba998fe4","Type":"ContainerStarted","Data":"9480344dc0e03344c54f191a2d1f154fc6f545040b54c25ea790074f0e89caeb"}
May 27 21:39:45.615072 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:45.615024    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc" podStartSLOduration=1.615010327 podStartE2EDuration="1.615010327s" podCreationTimestamp="2026-05-27 21:39:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:39:45.61398103 +0000 UTC m=+707.641800238" watchObservedRunningTime="2026-05-27 21:39:45.615010327 +0000 UTC m=+707.642829535"
May 27 21:39:46.197871 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:46.197830    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:46.202834 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:46.202808    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:46.593200 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:46.593116    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:46.594267 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:46.594246    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-jvclc"
May 27 21:39:49.033013 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.032976    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:39:49.036102 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.036085    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.038580 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.038563    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zgkln\""
May 27 21:39:49.038687 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.038563    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 27 21:39:49.046493 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.046471    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:39:49.103558 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.103525    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.103763 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.103576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.128590 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.128560    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:39:49.204924 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.204893    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.205117 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.204972    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.205546 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.205522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.218877 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.218847    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29\") pod \"limitador-limitador-7d549b5b-qgzhr\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") " pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.346910 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.346815    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:49.487834 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.487800    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:39:49.490802 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:39:49.490774    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bec640e_c84e_421d_a22a_f7d8dd5dca16.slice/crio-8d82e3617c5c65e6a559f9775c50fbae3ee80dec94f0cd5da8a97b32b1839a91 WatchSource:0}: Error finding container 8d82e3617c5c65e6a559f9775c50fbae3ee80dec94f0cd5da8a97b32b1839a91: Status 404 returned error can't find the container with id 8d82e3617c5c65e6a559f9775c50fbae3ee80dec94f0cd5da8a97b32b1839a91
May 27 21:39:49.603260 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.603164    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" event={"ID":"9bec640e-c84e-421d-a22a-f7d8dd5dca16","Type":"ContainerStarted","Data":"8d82e3617c5c65e6a559f9775c50fbae3ee80dec94f0cd5da8a97b32b1839a91"}
May 27 21:39:49.919259 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.919172    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:39:49.923571 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.923547    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:49.926526 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.926505    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tm4wr\""
May 27 21:39:49.932145 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:49.932119    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:39:50.012695 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.012659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6qgj\" (UniqueName: \"kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj\") pod \"authorino-f99f4b5cd-b5smf\" (UID: \"8b583da4-a855-4655-946e-6cf5ee5e4c81\") " pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:50.080525 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.080489    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:39:50.083451 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.083431    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:39:50.094195 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.094175    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:39:50.114303 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.114150    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6qgj\" (UniqueName: \"kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj\") pod \"authorino-f99f4b5cd-b5smf\" (UID: \"8b583da4-a855-4655-946e-6cf5ee5e4c81\") " pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:50.114303 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.114208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh7cm\" (UniqueName: \"kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm\") pod \"authorino-7498df8756-zhx4c\" (UID: \"9325d87a-0e5d-4558-87fb-8721b9e668dc\") " pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:39:50.123447 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.123425    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6qgj\" (UniqueName: \"kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj\") pod \"authorino-f99f4b5cd-b5smf\" (UID: \"8b583da4-a855-4655-946e-6cf5ee5e4c81\") " pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:50.214872 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.214823    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dh7cm\" (UniqueName: \"kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm\") pod \"authorino-7498df8756-zhx4c\" (UID: \"9325d87a-0e5d-4558-87fb-8721b9e668dc\") " pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:39:50.226893 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.226863    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh7cm\" (UniqueName: \"kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm\") pod \"authorino-7498df8756-zhx4c\" (UID: \"9325d87a-0e5d-4558-87fb-8721b9e668dc\") " pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:39:50.233455 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.233429    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:50.392822 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.392706    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:39:50.421982 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.421952    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:39:50.426556 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:39:50.426515    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b583da4_a855_4655_946e_6cf5ee5e4c81.slice/crio-43e33c34a607354404d7c8de2de5eeb90d929c20682bc7a9b57a25bf6b60b063 WatchSource:0}: Error finding container 43e33c34a607354404d7c8de2de5eeb90d929c20682bc7a9b57a25bf6b60b063: Status 404 returned error can't find the container with id 43e33c34a607354404d7c8de2de5eeb90d929c20682bc7a9b57a25bf6b60b063
May 27 21:39:50.568649 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.568597    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:39:50.612486 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.612447    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" event={"ID":"8b583da4-a855-4655-946e-6cf5ee5e4c81","Type":"ContainerStarted","Data":"43e33c34a607354404d7c8de2de5eeb90d929c20682bc7a9b57a25bf6b60b063"}
May 27 21:39:50.613566 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:50.613533    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zhx4c" event={"ID":"9325d87a-0e5d-4558-87fb-8721b9e668dc","Type":"ContainerStarted","Data":"4448f0f37be46fb84da13f7113b3fae10c3841943b5c227b5ff2356f26261444"}
May 27 21:39:52.626937 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:52.626899    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" event={"ID":"9bec640e-c84e-421d-a22a-f7d8dd5dca16","Type":"ContainerStarted","Data":"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"}
May 27 21:39:52.627723 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:52.627679    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:39:52.645079 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:52.645025    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" podStartSLOduration=0.6453941 podStartE2EDuration="3.645007754s" podCreationTimestamp="2026-05-27 21:39:49 +0000 UTC" firstStartedPulling="2026-05-27 21:39:49.492601799 +0000 UTC m=+711.520420986" lastFinishedPulling="2026-05-27 21:39:52.492215439 +0000 UTC m=+714.520034640" observedRunningTime="2026-05-27 21:39:52.643329999 +0000 UTC m=+714.671149205" watchObservedRunningTime="2026-05-27 21:39:52.645007754 +0000 UTC m=+714.672826963"
May 27 21:39:55.638485 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:55.638444    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zhx4c" event={"ID":"9325d87a-0e5d-4558-87fb-8721b9e668dc","Type":"ContainerStarted","Data":"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"}
May 27 21:39:55.639746 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:55.639709    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" event={"ID":"8b583da4-a855-4655-946e-6cf5ee5e4c81","Type":"ContainerStarted","Data":"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"}
May 27 21:39:55.652951 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:55.652911    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-zhx4c" podStartSLOduration=1.118722125 podStartE2EDuration="5.652897723s" podCreationTimestamp="2026-05-27 21:39:50 +0000 UTC" firstStartedPulling="2026-05-27 21:39:50.573329648 +0000 UTC m=+712.601148834" lastFinishedPulling="2026-05-27 21:39:55.107505244 +0000 UTC m=+717.135324432" observedRunningTime="2026-05-27 21:39:55.652404666 +0000 UTC m=+717.680223876" watchObservedRunningTime="2026-05-27 21:39:55.652897723 +0000 UTC m=+717.680716939"
May 27 21:39:55.667930 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:55.667883    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" podStartSLOduration=1.977692306 podStartE2EDuration="6.667864869s" podCreationTimestamp="2026-05-27 21:39:49 +0000 UTC" firstStartedPulling="2026-05-27 21:39:50.428291879 +0000 UTC m=+712.456111072" lastFinishedPulling="2026-05-27 21:39:55.118464448 +0000 UTC m=+717.146283635" observedRunningTime="2026-05-27 21:39:55.667427845 +0000 UTC m=+717.695247056" watchObservedRunningTime="2026-05-27 21:39:55.667864869 +0000 UTC m=+717.695684079"
May 27 21:39:55.695066 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:55.695036    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:39:57.645998 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:57.645928    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" podUID="8b583da4-a855-4655-946e-6cf5ee5e4c81" containerName="authorino" containerID="cri-o://bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015" gracePeriod=30
May 27 21:39:57.885538 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:57.885515    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:57.992977 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:57.992941    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6qgj\" (UniqueName: \"kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj\") pod \"8b583da4-a855-4655-946e-6cf5ee5e4c81\" (UID: \"8b583da4-a855-4655-946e-6cf5ee5e4c81\") "
May 27 21:39:57.995118 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:57.995089    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj" (OuterVolumeSpecName: "kube-api-access-p6qgj") pod "8b583da4-a855-4655-946e-6cf5ee5e4c81" (UID: "8b583da4-a855-4655-946e-6cf5ee5e4c81"). InnerVolumeSpecName "kube-api-access-p6qgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:39:58.093940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.093904    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6qgj\" (UniqueName: \"kubernetes.io/projected/8b583da4-a855-4655-946e-6cf5ee5e4c81-kube-api-access-p6qgj\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:39:58.655026 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.654992    2558 generic.go:358] "Generic (PLEG): container finished" podID="8b583da4-a855-4655-946e-6cf5ee5e4c81" containerID="bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015" exitCode=0
May 27 21:39:58.655396 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.655049    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-b5smf"
May 27 21:39:58.655396 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.655082    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" event={"ID":"8b583da4-a855-4655-946e-6cf5ee5e4c81","Type":"ContainerDied","Data":"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"}
May 27 21:39:58.655396 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.655116    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-b5smf" event={"ID":"8b583da4-a855-4655-946e-6cf5ee5e4c81","Type":"ContainerDied","Data":"43e33c34a607354404d7c8de2de5eeb90d929c20682bc7a9b57a25bf6b60b063"}
May 27 21:39:58.655396 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.655138    2558 scope.go:117] "RemoveContainer" containerID="bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"
May 27 21:39:58.662689 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.662672    2558 scope.go:117] "RemoveContainer" containerID="bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"
May 27 21:39:58.662929 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:39:58.662912    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015\": container with ID starting with bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015 not found: ID does not exist" containerID="bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"
May 27 21:39:58.662970 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.662939    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015"} err="failed to get container status \"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015\": rpc error: code = NotFound desc = could not find container \"bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015\": container with ID starting with bc8cba2e113de940b543c1cbdda61d6e902da1b03a773c60f03cbbf766bcc015 not found: ID does not exist"
May 27 21:39:58.671305 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.671284    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:39:58.675297 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:39:58.675281    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-b5smf"]
May 27 21:40:00.563108 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:00.563074    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b583da4-a855-4655-946e-6cf5ee5e4c81" path="/var/lib/kubelet/pods/8b583da4-a855-4655-946e-6cf5ee5e4c81/volumes"
May 27 21:40:04.635587 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:04.635554    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:40:05.021217 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.021178    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:40:05.021453 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.021429    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" podUID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" containerName="limitador" containerID="cri-o://b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd" gracePeriod=30
May 27 21:40:05.570635 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.570591    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:40:05.656065 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.655963    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file\") pod \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") "
May 27 21:40:05.656065 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.656051    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29\") pod \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\" (UID: \"9bec640e-c84e-421d-a22a-f7d8dd5dca16\") "
May 27 21:40:05.656507 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.656316    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file" (OuterVolumeSpecName: "config-file") pod "9bec640e-c84e-421d-a22a-f7d8dd5dca16" (UID: "9bec640e-c84e-421d-a22a-f7d8dd5dca16"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 27 21:40:05.658254 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.658225    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29" (OuterVolumeSpecName: "kube-api-access-fhn29") pod "9bec640e-c84e-421d-a22a-f7d8dd5dca16" (UID: "9bec640e-c84e-421d-a22a-f7d8dd5dca16"). InnerVolumeSpecName "kube-api-access-fhn29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:40:05.680226 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.680194    2558 generic.go:358] "Generic (PLEG): container finished" podID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" containerID="b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd" exitCode=0
May 27 21:40:05.680360 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.680253    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr"
May 27 21:40:05.680360 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.680266    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" event={"ID":"9bec640e-c84e-421d-a22a-f7d8dd5dca16","Type":"ContainerDied","Data":"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"}
May 27 21:40:05.680360 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.680294    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-qgzhr" event={"ID":"9bec640e-c84e-421d-a22a-f7d8dd5dca16","Type":"ContainerDied","Data":"8d82e3617c5c65e6a559f9775c50fbae3ee80dec94f0cd5da8a97b32b1839a91"}
May 27 21:40:05.680360 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.680309    2558 scope.go:117] "RemoveContainer" containerID="b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"
May 27 21:40:05.688356 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.688338    2558 scope.go:117] "RemoveContainer" containerID="b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"
May 27 21:40:05.688640 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:40:05.688602    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd\": container with ID starting with b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd not found: ID does not exist" containerID="b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"
May 27 21:40:05.688719 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.688653    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd"} err="failed to get container status \"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd\": rpc error: code = NotFound desc = could not find container \"b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd\": container with ID starting with b618da628d97b6580f00c6d5c8c5c5ec615703bd22b0c35fcb1ddca08d0626bd not found: ID does not exist"
May 27 21:40:05.705956 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.705899    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:40:05.713164 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.713136    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-qgzhr"]
May 27 21:40:05.757062 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.757022    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9bec640e-c84e-421d-a22a-f7d8dd5dca16-config-file\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:40:05.757062 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:05.757056    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhn29\" (UniqueName: \"kubernetes.io/projected/9bec640e-c84e-421d-a22a-f7d8dd5dca16-kube-api-access-fhn29\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:40:06.562633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:06.562582    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" path="/var/lib/kubelet/pods/9bec640e-c84e-421d-a22a-f7d8dd5dca16/volumes"
May 27 21:40:10.137609 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137577    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6n72f"]
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137863    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" containerName="limitador"
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137875    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" containerName="limitador"
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137886    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b583da4-a855-4655-946e-6cf5ee5e4c81" containerName="authorino"
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137891    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b583da4-a855-4655-946e-6cf5ee5e4c81" containerName="authorino"
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137950    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8b583da4-a855-4655-946e-6cf5ee5e4c81" containerName="authorino"
May 27 21:40:10.137992 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.137959    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9bec640e-c84e-421d-a22a-f7d8dd5dca16" containerName="limitador"
May 27 21:40:10.142299 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.142274    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.144633 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.144596    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sg7z5\""
May 27 21:40:10.144772 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.144666    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 27 21:40:10.148915 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.148890    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6n72f"]
May 27 21:40:10.295507 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.295474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d72f7760-6561-410c-b1bf-8df7d87705b4-data\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.295715 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.295589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4jrx\" (UniqueName: \"kubernetes.io/projected/d72f7760-6561-410c-b1bf-8df7d87705b4-kube-api-access-b4jrx\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.396856 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.396774    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d72f7760-6561-410c-b1bf-8df7d87705b4-data\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.396958 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.396870    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4jrx\" (UniqueName: \"kubernetes.io/projected/d72f7760-6561-410c-b1bf-8df7d87705b4-kube-api-access-b4jrx\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.397177 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.397154    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d72f7760-6561-410c-b1bf-8df7d87705b4-data\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.406802 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.406777    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4jrx\" (UniqueName: \"kubernetes.io/projected/d72f7760-6561-410c-b1bf-8df7d87705b4-kube-api-access-b4jrx\") pod \"postgres-68c4fbbd6f-6n72f\" (UID: \"d72f7760-6561-410c-b1bf-8df7d87705b4\") " pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.455796 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.455766    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:10.592178 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.592154    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6n72f"]
May 27 21:40:10.594433 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:40:10.594408    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd72f7760_6561_410c_b1bf_8df7d87705b4.slice/crio-2718556842f8fe2926ddaf49b65e00f15e69bf101d6c48c882f31434b9ca6704 WatchSource:0}: Error finding container 2718556842f8fe2926ddaf49b65e00f15e69bf101d6c48c882f31434b9ca6704: Status 404 returned error can't find the container with id 2718556842f8fe2926ddaf49b65e00f15e69bf101d6c48c882f31434b9ca6704
May 27 21:40:10.699641 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:10.699583    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6n72f" event={"ID":"d72f7760-6561-410c-b1bf-8df7d87705b4","Type":"ContainerStarted","Data":"2718556842f8fe2926ddaf49b65e00f15e69bf101d6c48c882f31434b9ca6704"}
May 27 21:40:16.720630 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:16.720590    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6n72f" event={"ID":"d72f7760-6561-410c-b1bf-8df7d87705b4","Type":"ContainerStarted","Data":"bc8a941adc9a3e0ce6227cf55f207102a273a9245933782a89e3a043aef54d09"}
May 27 21:40:16.721060 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:16.720754    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:16.747081 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:16.747021    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-6n72f" podStartSLOduration=1.296767211 podStartE2EDuration="6.74700056s" podCreationTimestamp="2026-05-27 21:40:10 +0000 UTC" firstStartedPulling="2026-05-27 21:40:10.5956743 +0000 UTC m=+732.623493486" lastFinishedPulling="2026-05-27 21:40:16.045907642 +0000 UTC m=+738.073726835" observedRunningTime="2026-05-27 21:40:16.743509184 +0000 UTC m=+738.771328392" watchObservedRunningTime="2026-05-27 21:40:16.74700056 +0000 UTC m=+738.774819770"
May 27 21:40:22.752461 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:22.752428    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-6n72f"
May 27 21:40:23.349330 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.349295    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qh854"]
May 27 21:40:23.358037 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.358013    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.359607 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.359577    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qh854"]
May 27 21:40:23.505592 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.505558    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klqxk\" (UniqueName: \"kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk\") pod \"authorino-8b475cf9f-qh854\" (UID: \"addc1d5c-11ca-49c7-b6c4-f221cb207d92\") " pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.563258 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.563225    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qh854"]
May 27 21:40:23.563472 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:40:23.563451    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-klqxk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-qh854" podUID="addc1d5c-11ca-49c7-b6c4-f221cb207d92"
May 27 21:40:23.593327 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.593288    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-669946bfb-w8f5x"]
May 27 21:40:23.596993 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.596970    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.604129 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.604100    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-669946bfb-w8f5x"]
May 27 21:40:23.606174 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.606148    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klqxk\" (UniqueName: \"kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk\") pod \"authorino-8b475cf9f-qh854\" (UID: \"addc1d5c-11ca-49c7-b6c4-f221cb207d92\") " pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.620145 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.620115    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klqxk\" (UniqueName: \"kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk\") pod \"authorino-8b475cf9f-qh854\" (UID: \"addc1d5c-11ca-49c7-b6c4-f221cb207d92\") " pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.682397 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.682369    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-669946bfb-w8f5x"]
May 27 21:40:23.682607 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:40:23.682587    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-f2vqs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-669946bfb-w8f5x" podUID="d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd"
May 27 21:40:23.707492 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.707465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2vqs\" (UniqueName: \"kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs\") pod \"authorino-669946bfb-w8f5x\" (UID: \"d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd\") " pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.710161 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.710138    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:40:23.713865 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.713850    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.716192 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.716170    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 27 21:40:23.720366 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.720338    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:40:23.748410 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.748372    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.748565 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.748373    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.752570 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.752551    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.755544 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.755525    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:23.808862 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.808833    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsxgt\" (UniqueName: \"kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.809017 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.808880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.809017 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.808922    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2vqs\" (UniqueName: \"kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs\") pod \"authorino-669946bfb-w8f5x\" (UID: \"d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd\") " pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.817331 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.817307    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2vqs\" (UniqueName: \"kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs\") pod \"authorino-669946bfb-w8f5x\" (UID: \"d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd\") " pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:23.909375 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.909299    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klqxk\" (UniqueName: \"kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk\") pod \"addc1d5c-11ca-49c7-b6c4-f221cb207d92\" (UID: \"addc1d5c-11ca-49c7-b6c4-f221cb207d92\") "
May 27 21:40:23.909520 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.909381    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2vqs\" (UniqueName: \"kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs\") pod \"d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd\" (UID: \"d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd\") "
May 27 21:40:23.909520 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.909498    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsxgt\" (UniqueName: \"kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.909661 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.909551    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.911670 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.911639    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk" (OuterVolumeSpecName: "kube-api-access-klqxk") pod "addc1d5c-11ca-49c7-b6c4-f221cb207d92" (UID: "addc1d5c-11ca-49c7-b6c4-f221cb207d92"). InnerVolumeSpecName "kube-api-access-klqxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:40:23.911670 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.911660    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs" (OuterVolumeSpecName: "kube-api-access-f2vqs") pod "d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd" (UID: "d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd"). InnerVolumeSpecName "kube-api-access-f2vqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:40:23.912029 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.912012    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:23.917906 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:23.917888    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsxgt\" (UniqueName: \"kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt\") pod \"authorino-857bdfbfcb-zzkk4\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") " pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:24.010402 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.010370    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klqxk\" (UniqueName: \"kubernetes.io/projected/addc1d5c-11ca-49c7-b6c4-f221cb207d92-kube-api-access-klqxk\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:40:24.010402 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.010395    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2vqs\" (UniqueName: \"kubernetes.io/projected/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd-kube-api-access-f2vqs\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:40:24.046351 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.046323    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:40:24.174009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.173828    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:40:24.176662 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:40:24.176627    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc05c1d4f_8bf8_4244_830e_71135c5663d7.slice/crio-6c32b62a089d05affda89044fced2e63e1ce3e15f42a5ba928038a30ac7c21c9 WatchSource:0}: Error finding container 6c32b62a089d05affda89044fced2e63e1ce3e15f42a5ba928038a30ac7c21c9: Status 404 returned error can't find the container with id 6c32b62a089d05affda89044fced2e63e1ce3e15f42a5ba928038a30ac7c21c9
May 27 21:40:24.754059 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.754018    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" event={"ID":"c05c1d4f-8bf8-4244-830e-71135c5663d7","Type":"ContainerStarted","Data":"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"}
May 27 21:40:24.754637 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.754067    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" event={"ID":"c05c1d4f-8bf8-4244-830e-71135c5663d7","Type":"ContainerStarted","Data":"6c32b62a089d05affda89044fced2e63e1ce3e15f42a5ba928038a30ac7c21c9"}
May 27 21:40:24.754637 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.754180    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669946bfb-w8f5x"
May 27 21:40:24.754637 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.754463    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-qh854"
May 27 21:40:24.772040 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.771987    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" podStartSLOduration=1.321006419 podStartE2EDuration="1.771973109s" podCreationTimestamp="2026-05-27 21:40:23 +0000 UTC" firstStartedPulling="2026-05-27 21:40:24.178140528 +0000 UTC m=+746.205959718" lastFinishedPulling="2026-05-27 21:40:24.629107221 +0000 UTC m=+746.656926408" observedRunningTime="2026-05-27 21:40:24.769799441 +0000 UTC m=+746.797618649" watchObservedRunningTime="2026-05-27 21:40:24.771973109 +0000 UTC m=+746.799792318"
May 27 21:40:24.797811 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.797782    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-669946bfb-w8f5x"]
May 27 21:40:24.805126 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.805098    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-669946bfb-w8f5x"]
May 27 21:40:24.806350 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.806325    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:40:24.806554 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.806533    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-zhx4c" podUID="9325d87a-0e5d-4558-87fb-8721b9e668dc" containerName="authorino" containerID="cri-o://53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377" gracePeriod=30
May 27 21:40:24.831363 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.831332    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qh854"]
May 27 21:40:24.835371 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:24.835348    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-qh854"]
May 27 21:40:25.044340 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.044320    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:40:25.120012 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.119928    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dh7cm\" (UniqueName: \"kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm\") pod \"9325d87a-0e5d-4558-87fb-8721b9e668dc\" (UID: \"9325d87a-0e5d-4558-87fb-8721b9e668dc\") "
May 27 21:40:25.122118 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.122095    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm" (OuterVolumeSpecName: "kube-api-access-dh7cm") pod "9325d87a-0e5d-4558-87fb-8721b9e668dc" (UID: "9325d87a-0e5d-4558-87fb-8721b9e668dc"). InnerVolumeSpecName "kube-api-access-dh7cm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:40:25.220801 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.220763    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dh7cm\" (UniqueName: \"kubernetes.io/projected/9325d87a-0e5d-4558-87fb-8721b9e668dc-kube-api-access-dh7cm\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:40:25.758520 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.758484    2558 generic.go:358] "Generic (PLEG): container finished" podID="9325d87a-0e5d-4558-87fb-8721b9e668dc" containerID="53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377" exitCode=0
May 27 21:40:25.759009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.758531    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-zhx4c"
May 27 21:40:25.759009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.758565    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zhx4c" event={"ID":"9325d87a-0e5d-4558-87fb-8721b9e668dc","Type":"ContainerDied","Data":"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"}
May 27 21:40:25.759009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.758602    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-zhx4c" event={"ID":"9325d87a-0e5d-4558-87fb-8721b9e668dc","Type":"ContainerDied","Data":"4448f0f37be46fb84da13f7113b3fae10c3841943b5c227b5ff2356f26261444"}
May 27 21:40:25.759009 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.758640    2558 scope.go:117] "RemoveContainer" containerID="53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"
May 27 21:40:25.766822 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.766807    2558 scope.go:117] "RemoveContainer" containerID="53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"
May 27 21:40:25.767079 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:40:25.767060    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377\": container with ID starting with 53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377 not found: ID does not exist" containerID="53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"
May 27 21:40:25.767124 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.767087    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377"} err="failed to get container status \"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377\": rpc error: code = NotFound desc = could not find container \"53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377\": container with ID starting with 53498adff0d741332527bb0def10bceef2591ab19f9562dfe83050c1d5b8a377 not found: ID does not exist"
May 27 21:40:25.779996 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.779972    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:40:25.788482 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:25.788460    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-zhx4c"]
May 27 21:40:26.562826 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:26.562794    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9325d87a-0e5d-4558-87fb-8721b9e668dc" path="/var/lib/kubelet/pods/9325d87a-0e5d-4558-87fb-8721b9e668dc/volumes"
May 27 21:40:26.563115 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:26.563103    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="addc1d5c-11ca-49c7-b6c4-f221cb207d92" path="/var/lib/kubelet/pods/addc1d5c-11ca-49c7-b6c4-f221cb207d92/volumes"
May 27 21:40:26.563288 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:40:26.563277    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd" path="/var/lib/kubelet/pods/d6a1a2d2-507a-4c7e-bcd0-1dfc4adb48bd/volumes"
May 27 21:41:02.718886 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.718850    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5d9548bf9c-x4xlr"]
May 27 21:41:02.719283 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.719129    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9325d87a-0e5d-4558-87fb-8721b9e668dc" containerName="authorino"
May 27 21:41:02.719283 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.719139    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9325d87a-0e5d-4558-87fb-8721b9e668dc" containerName="authorino"
May 27 21:41:02.719283 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.719189    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="9325d87a-0e5d-4558-87fb-8721b9e668dc" containerName="authorino"
May 27 21:41:02.723220 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.723203    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.725960 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.725930    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 27 21:41:02.738118 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.736781    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d9548bf9c-x4xlr"]
May 27 21:41:02.819948 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.819911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ws47\" (UniqueName: \"kubernetes.io/projected/c4a21bb1-5bc8-4a56-8932-957ea7e07128-kube-api-access-6ws47\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.819948 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.819951    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a21bb1-5bc8-4a56-8932-957ea7e07128-maas-api-tls\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.920659 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.920597    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ws47\" (UniqueName: \"kubernetes.io/projected/c4a21bb1-5bc8-4a56-8932-957ea7e07128-kube-api-access-6ws47\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.920659 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.920663    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a21bb1-5bc8-4a56-8932-957ea7e07128-maas-api-tls\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.923357 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.923328    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a21bb1-5bc8-4a56-8932-957ea7e07128-maas-api-tls\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:02.929059 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:02.929030    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ws47\" (UniqueName: \"kubernetes.io/projected/c4a21bb1-5bc8-4a56-8932-957ea7e07128-kube-api-access-6ws47\") pod \"maas-api-5d9548bf9c-x4xlr\" (UID: \"c4a21bb1-5bc8-4a56-8932-957ea7e07128\") " pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:03.034380 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:03.034290    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:03.177692 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:03.177662    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5d9548bf9c-x4xlr"]
May 27 21:41:03.179269 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:41:03.179231    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a21bb1_5bc8_4a56_8932_957ea7e07128.slice/crio-5508c3d21aa94b5cfc72fdeac7d84b8c69992a77e8c18c1a7954d8f8e7f33309 WatchSource:0}: Error finding container 5508c3d21aa94b5cfc72fdeac7d84b8c69992a77e8c18c1a7954d8f8e7f33309: Status 404 returned error can't find the container with id 5508c3d21aa94b5cfc72fdeac7d84b8c69992a77e8c18c1a7954d8f8e7f33309
May 27 21:41:03.886466 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:03.886422    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d9548bf9c-x4xlr" event={"ID":"c4a21bb1-5bc8-4a56-8932-957ea7e07128","Type":"ContainerStarted","Data":"5508c3d21aa94b5cfc72fdeac7d84b8c69992a77e8c18c1a7954d8f8e7f33309"}
May 27 21:41:06.897890 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:06.897851    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5d9548bf9c-x4xlr" event={"ID":"c4a21bb1-5bc8-4a56-8932-957ea7e07128","Type":"ContainerStarted","Data":"9ff22d1fde7321899517ba2a8ce3f028c3144f0e82aa0030bad5a058a0d2b904"}
May 27 21:41:06.898332 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:06.897983    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:06.914841 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:06.914796    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-5d9548bf9c-x4xlr" podStartSLOduration=2.182944367 podStartE2EDuration="4.914782976s" podCreationTimestamp="2026-05-27 21:41:02 +0000 UTC" firstStartedPulling="2026-05-27 21:41:03.180606231 +0000 UTC m=+785.208425419" lastFinishedPulling="2026-05-27 21:41:05.912444842 +0000 UTC m=+787.940264028" observedRunningTime="2026-05-27 21:41:06.914224825 +0000 UTC m=+788.942044035" watchObservedRunningTime="2026-05-27 21:41:06.914782976 +0000 UTC m=+788.942602184"
May 27 21:41:12.908125 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:12.908095    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5d9548bf9c-x4xlr"
May 27 21:41:36.190940 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.190902    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"]
May 27 21:41:36.194520 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.194502    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.197658 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.197640    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 27 21:41:36.197779 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.197642    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v28hb\""
May 27 21:41:36.197779 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.197676    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 27 21:41:36.197779 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.197643    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 27 21:41:36.203774 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.203753    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"]
May 27 21:41:36.314064 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.314234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314078    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwprm\" (UniqueName: \"kubernetes.io/projected/264f760a-03cb-4860-b6e5-987af6199821-kube-api-access-cwprm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.314234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.314234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314132    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.314234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f760a-03cb-4860-b6e5-987af6199821-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.314234 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.314213    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415193 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415160    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415197    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwprm\" (UniqueName: \"kubernetes.io/projected/264f760a-03cb-4860-b6e5-987af6199821-kube-api-access-cwprm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415218    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415374 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415242    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415377    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f760a-03cb-4860-b6e5-987af6199821-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415543 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415460    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415685 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415649    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415735 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415710    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.415820 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.415805    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.417688 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.417660    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/264f760a-03cb-4860-b6e5-987af6199821-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.417913 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.417896    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/264f760a-03cb-4860-b6e5-987af6199821-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.423059 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.423033    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwprm\" (UniqueName: \"kubernetes.io/projected/264f760a-03cb-4860-b6e5-987af6199821-kube-api-access-cwprm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn\" (UID: \"264f760a-03cb-4860-b6e5-987af6199821\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.504695 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.504578    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:36.639493 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.639464    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"]
May 27 21:41:36.641851 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:41:36.641822    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264f760a_03cb_4860_b6e5_987af6199821.slice/crio-09c107ef56de15e9a16be9e3208168f9ea9f74f8a908214f0dae3abfcd0e5cc1 WatchSource:0}: Error finding container 09c107ef56de15e9a16be9e3208168f9ea9f74f8a908214f0dae3abfcd0e5cc1: Status 404 returned error can't find the container with id 09c107ef56de15e9a16be9e3208168f9ea9f74f8a908214f0dae3abfcd0e5cc1
May 27 21:41:36.991110 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:36.991081    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn" event={"ID":"264f760a-03cb-4860-b6e5-987af6199821","Type":"ContainerStarted","Data":"09c107ef56de15e9a16be9e3208168f9ea9f74f8a908214f0dae3abfcd0e5cc1"}
May 27 21:41:43.013397 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:43.013357    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn" event={"ID":"264f760a-03cb-4860-b6e5-987af6199821","Type":"ContainerStarted","Data":"032cb33c281108ae0efad61da44af1d24d4fa388dbe2856fe858187d2981ee5d"}
May 27 21:41:49.033336 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:49.033299    2558 generic.go:358] "Generic (PLEG): container finished" podID="264f760a-03cb-4860-b6e5-987af6199821" containerID="032cb33c281108ae0efad61da44af1d24d4fa388dbe2856fe858187d2981ee5d" exitCode=0
May 27 21:41:49.033739 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:49.033356    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn" event={"ID":"264f760a-03cb-4860-b6e5-987af6199821","Type":"ContainerDied","Data":"032cb33c281108ae0efad61da44af1d24d4fa388dbe2856fe858187d2981ee5d"}
May 27 21:41:51.041824 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:51.041789    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn" event={"ID":"264f760a-03cb-4860-b6e5-987af6199821","Type":"ContainerStarted","Data":"2a41639af56d044fd59961039bf63bde387ad1338ef3af7f57b989a0c3140ff0"}
May 27 21:41:51.042218 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:51.042004    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:41:51.073284 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:41:51.073216    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn" podStartSLOduration=1.6467612520000001 podStartE2EDuration="15.073197866s" podCreationTimestamp="2026-05-27 21:41:36 +0000 UTC" firstStartedPulling="2026-05-27 21:41:36.644353259 +0000 UTC m=+818.672172464" lastFinishedPulling="2026-05-27 21:41:50.070789888 +0000 UTC m=+832.098609078" observedRunningTime="2026-05-27 21:41:51.071286286 +0000 UTC m=+833.099105495" watchObservedRunningTime="2026-05-27 21:41:51.073197866 +0000 UTC m=+833.101017075"
May 27 21:42:02.058572 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:02.058537    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn"
May 27 21:42:12.597068 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.597034    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"]
May 27 21:42:12.615231 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.615206    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"]
May 27 21:42:12.615387 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.615317    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.617698 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.617674    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 27 21:42:12.709197 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709156    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.709197 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709200    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a401a5-2b23-42bf-8a25-3bcc3926a947-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.709404 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.709404 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7r9\" (UniqueName: \"kubernetes.io/projected/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kube-api-access-kz7r9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.709404 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709276    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.709404 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.709360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.809832 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.809797    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810042 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.809843    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a401a5-2b23-42bf-8a25-3bcc3926a947-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810042 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.809985    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810042 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810022    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7r9\" (UniqueName: \"kubernetes.io/projected/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kube-api-access-kz7r9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810214 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810047    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810214 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810179    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810320 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810252    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810441 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.810566 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.810485    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.812313 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.812289    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9a401a5-2b23-42bf-8a25-3bcc3926a947-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.812459 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.812440    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9a401a5-2b23-42bf-8a25-3bcc3926a947-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.819673 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.819590    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7r9\" (UniqueName: \"kubernetes.io/projected/f9a401a5-2b23-42bf-8a25-3bcc3926a947-kube-api-access-kz7r9\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b\" (UID: \"f9a401a5-2b23-42bf-8a25-3bcc3926a947\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:12.925825 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:12.925733    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:13.059012 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:13.058990    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"]
May 27 21:42:13.061767 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:42:13.061738    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a401a5_2b23_42bf_8a25_3bcc3926a947.slice/crio-7efca60f9df840c27799a3ca7c7a151d927765dc235ce0afad1276ef77c9d8e0 WatchSource:0}: Error finding container 7efca60f9df840c27799a3ca7c7a151d927765dc235ce0afad1276ef77c9d8e0: Status 404 returned error can't find the container with id 7efca60f9df840c27799a3ca7c7a151d927765dc235ce0afad1276ef77c9d8e0
May 27 21:42:13.063956 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:13.063939    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 21:42:13.118322 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:13.118297    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b" event={"ID":"f9a401a5-2b23-42bf-8a25-3bcc3926a947","Type":"ContainerStarted","Data":"7efca60f9df840c27799a3ca7c7a151d927765dc235ce0afad1276ef77c9d8e0"}
May 27 21:42:14.123204 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:14.123168    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b" event={"ID":"f9a401a5-2b23-42bf-8a25-3bcc3926a947","Type":"ContainerStarted","Data":"6492cf455f3df7481d4df07509b1b5f40ba2f758b0bbadc4872888cc8ce03dc4"}
May 27 21:42:19.141136 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:19.141101    2558 generic.go:358] "Generic (PLEG): container finished" podID="f9a401a5-2b23-42bf-8a25-3bcc3926a947" containerID="6492cf455f3df7481d4df07509b1b5f40ba2f758b0bbadc4872888cc8ce03dc4" exitCode=0
May 27 21:42:19.141552 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:19.141149    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b" event={"ID":"f9a401a5-2b23-42bf-8a25-3bcc3926a947","Type":"ContainerDied","Data":"6492cf455f3df7481d4df07509b1b5f40ba2f758b0bbadc4872888cc8ce03dc4"}
May 27 21:42:20.145954 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:20.145919    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b" event={"ID":"f9a401a5-2b23-42bf-8a25-3bcc3926a947","Type":"ContainerStarted","Data":"3f8b853be9a39928f44bfeafc53aa07aedcf9a46f66733e29b0c9f6c01b13884"}
May 27 21:42:20.146337 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:20.146140    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:20.165165 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:20.165118    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b" podStartSLOduration=7.955147256 podStartE2EDuration="8.165106787s" podCreationTimestamp="2026-05-27 21:42:12 +0000 UTC" firstStartedPulling="2026-05-27 21:42:19.141737715 +0000 UTC m=+861.169556905" lastFinishedPulling="2026-05-27 21:42:19.35169725 +0000 UTC m=+861.379516436" observedRunningTime="2026-05-27 21:42:20.164038497 +0000 UTC m=+862.191857705" watchObservedRunningTime="2026-05-27 21:42:20.165106787 +0000 UTC m=+862.192925996"
May 27 21:42:25.790064 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.790032    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"]
May 27 21:42:25.796553 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.796529    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.798815 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.798794    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 27 21:42:25.802835 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.802814    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"]
May 27 21:42:25.916020 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.915983    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.916020 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.916020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0be2df01-d096-4eec-9ea3-2d016cba4caa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.916225 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.916045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.916225 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.916087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.916225 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.916110    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:25.916225 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:25.916172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgxcj\" (UniqueName: \"kubernetes.io/projected/0be2df01-d096-4eec-9ea3-2d016cba4caa-kube-api-access-bgxcj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.016867 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.016826    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.016867 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.016873    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0be2df01-d096-4eec-9ea3-2d016cba4caa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017073 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017054    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017113 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017101    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017156 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017141    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017195 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017176    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgxcj\" (UniqueName: \"kubernetes.io/projected/0be2df01-d096-4eec-9ea3-2d016cba4caa-kube-api-access-bgxcj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017365 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017337    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017522 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017495    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.017668 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.017607    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.019377 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.019344    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0be2df01-d096-4eec-9ea3-2d016cba4caa-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.019585 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.019568    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0be2df01-d096-4eec-9ea3-2d016cba4caa-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.029589 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.029563    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgxcj\" (UniqueName: \"kubernetes.io/projected/0be2df01-d096-4eec-9ea3-2d016cba4caa-kube-api-access-bgxcj\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-vklv6\" (UID: \"0be2df01-d096-4eec-9ea3-2d016cba4caa\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.109354 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.109257    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:26.246717 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:26.246682    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"]
May 27 21:42:26.249831 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:42:26.249802    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be2df01_d096_4eec_9ea3_2d016cba4caa.slice/crio-ceb7f01dc469ac7b0024ef82c66a2817c54313e32bdf36486237d9d7d81dc675 WatchSource:0}: Error finding container ceb7f01dc469ac7b0024ef82c66a2817c54313e32bdf36486237d9d7d81dc675: Status 404 returned error can't find the container with id ceb7f01dc469ac7b0024ef82c66a2817c54313e32bdf36486237d9d7d81dc675
May 27 21:42:27.172437 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:27.172389    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6" event={"ID":"0be2df01-d096-4eec-9ea3-2d016cba4caa","Type":"ContainerStarted","Data":"6d109659cdc2f86ef706001123ee479bb6751ceb0f237453534776c01f92d492"}
May 27 21:42:27.172437 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:27.172433    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6" event={"ID":"0be2df01-d096-4eec-9ea3-2d016cba4caa","Type":"ContainerStarted","Data":"ceb7f01dc469ac7b0024ef82c66a2817c54313e32bdf36486237d9d7d81dc675"}
May 27 21:42:31.163275 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:31.163241    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b"
May 27 21:42:32.197850 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:32.197810    2558 generic.go:358] "Generic (PLEG): container finished" podID="0be2df01-d096-4eec-9ea3-2d016cba4caa" containerID="6d109659cdc2f86ef706001123ee479bb6751ceb0f237453534776c01f92d492" exitCode=0
May 27 21:42:32.198229 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:32.197884    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6" event={"ID":"0be2df01-d096-4eec-9ea3-2d016cba4caa","Type":"ContainerDied","Data":"6d109659cdc2f86ef706001123ee479bb6751ceb0f237453534776c01f92d492"}
May 27 21:42:33.202292 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:33.202254    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6" event={"ID":"0be2df01-d096-4eec-9ea3-2d016cba4caa","Type":"ContainerStarted","Data":"b2a684f4dcff035068e112a609dc6ef341c29c16641bc8b243ebc6f0a8142065"}
May 27 21:42:33.202800 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:33.202494    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:42:33.225912 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:33.225862    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6" podStartSLOduration=7.998028609 podStartE2EDuration="8.225847694s" podCreationTimestamp="2026-05-27 21:42:25 +0000 UTC" firstStartedPulling="2026-05-27 21:42:32.198500383 +0000 UTC m=+874.226319570" lastFinishedPulling="2026-05-27 21:42:32.426319466 +0000 UTC m=+874.454138655" observedRunningTime="2026-05-27 21:42:33.224446024 +0000 UTC m=+875.252265246" watchObservedRunningTime="2026-05-27 21:42:33.225847694 +0000 UTC m=+875.253666955"
May 27 21:42:39.400538 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.400499    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-869cc555bf-9slvx"]
May 27 21:42:39.404885 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.404869    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.415959 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.415931    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869cc555bf-9slvx"]
May 27 21:42:39.536220 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.536188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmm52\" (UniqueName: \"kubernetes.io/projected/2154823e-0478-41c4-b05b-0c6891054007-kube-api-access-lmm52\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.536378 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.536268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2154823e-0478-41c4-b05b-0c6891054007-tls-cert\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.637675 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.637631    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2154823e-0478-41c4-b05b-0c6891054007-tls-cert\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.637847 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.637713    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lmm52\" (UniqueName: \"kubernetes.io/projected/2154823e-0478-41c4-b05b-0c6891054007-kube-api-access-lmm52\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.640179 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.640154    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2154823e-0478-41c4-b05b-0c6891054007-tls-cert\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.646455 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.646429    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmm52\" (UniqueName: \"kubernetes.io/projected/2154823e-0478-41c4-b05b-0c6891054007-kube-api-access-lmm52\") pod \"authorino-869cc555bf-9slvx\" (UID: \"2154823e-0478-41c4-b05b-0c6891054007\") " pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.738894 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.738862    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869cc555bf-9slvx"
May 27 21:42:39.867436 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:39.867407    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869cc555bf-9slvx"]
May 27 21:42:39.870052 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:42:39.870018    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2154823e_0478_41c4_b05b_0c6891054007.slice/crio-5a507848c784a9311b244c74235014eb50c31d6b8b8abbe3d9518ff6152f0297 WatchSource:0}: Error finding container 5a507848c784a9311b244c74235014eb50c31d6b8b8abbe3d9518ff6152f0297: Status 404 returned error can't find the container with id 5a507848c784a9311b244c74235014eb50c31d6b8b8abbe3d9518ff6152f0297
May 27 21:42:40.225786 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:40.225743    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869cc555bf-9slvx" event={"ID":"2154823e-0478-41c4-b05b-0c6891054007","Type":"ContainerStarted","Data":"5a507848c784a9311b244c74235014eb50c31d6b8b8abbe3d9518ff6152f0297"}
May 27 21:42:41.231752 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.231707    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869cc555bf-9slvx" event={"ID":"2154823e-0478-41c4-b05b-0c6891054007","Type":"ContainerStarted","Data":"680b3e241be4cb8136d4ea5573cc929711d7a34b8db647846c6816538605c049"}
May 27 21:42:41.251189 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.251131    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-869cc555bf-9slvx" podStartSLOduration=1.8797061560000001 podStartE2EDuration="2.251111877s" podCreationTimestamp="2026-05-27 21:42:39 +0000 UTC" firstStartedPulling="2026-05-27 21:42:39.871313271 +0000 UTC m=+881.899132457" lastFinishedPulling="2026-05-27 21:42:40.242718991 +0000 UTC m=+882.270538178" observedRunningTime="2026-05-27 21:42:41.24981086 +0000 UTC m=+883.277630071" watchObservedRunningTime="2026-05-27 21:42:41.251111877 +0000 UTC m=+883.278931088"
May 27 21:42:41.280734 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.280699    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:42:41.280985 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.280961    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" podUID="c05c1d4f-8bf8-4244-830e-71135c5663d7" containerName="authorino" containerID="cri-o://bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2" gracePeriod=30
May 27 21:42:41.541887 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.541858    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:42:41.655417 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.655386    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert\") pod \"c05c1d4f-8bf8-4244-830e-71135c5663d7\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") "
May 27 21:42:41.655652 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.655533    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsxgt\" (UniqueName: \"kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt\") pod \"c05c1d4f-8bf8-4244-830e-71135c5663d7\" (UID: \"c05c1d4f-8bf8-4244-830e-71135c5663d7\") "
May 27 21:42:41.657791 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.657750    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt" (OuterVolumeSpecName: "kube-api-access-lsxgt") pod "c05c1d4f-8bf8-4244-830e-71135c5663d7" (UID: "c05c1d4f-8bf8-4244-830e-71135c5663d7"). InnerVolumeSpecName "kube-api-access-lsxgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:42:41.665906 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.665881    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c05c1d4f-8bf8-4244-830e-71135c5663d7" (UID: "c05c1d4f-8bf8-4244-830e-71135c5663d7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 27 21:42:41.757189 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.757139    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsxgt\" (UniqueName: \"kubernetes.io/projected/c05c1d4f-8bf8-4244-830e-71135c5663d7-kube-api-access-lsxgt\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:42:41.757189 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:41.757183    2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c05c1d4f-8bf8-4244-830e-71135c5663d7-tls-cert\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:42:42.237116 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.237077    2558 generic.go:358] "Generic (PLEG): container finished" podID="c05c1d4f-8bf8-4244-830e-71135c5663d7" containerID="bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2" exitCode=0
May 27 21:42:42.237579 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.237126    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4"
May 27 21:42:42.237579 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.237163    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" event={"ID":"c05c1d4f-8bf8-4244-830e-71135c5663d7","Type":"ContainerDied","Data":"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"}
May 27 21:42:42.237579 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.237206    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-857bdfbfcb-zzkk4" event={"ID":"c05c1d4f-8bf8-4244-830e-71135c5663d7","Type":"ContainerDied","Data":"6c32b62a089d05affda89044fced2e63e1ce3e15f42a5ba928038a30ac7c21c9"}
May 27 21:42:42.237579 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.237227    2558 scope.go:117] "RemoveContainer" containerID="bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"
May 27 21:42:42.247137 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.247118    2558 scope.go:117] "RemoveContainer" containerID="bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"
May 27 21:42:42.247381 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:42:42.247364    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2\": container with ID starting with bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2 not found: ID does not exist" containerID="bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"
May 27 21:42:42.247432 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.247391    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2"} err="failed to get container status \"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2\": rpc error: code = NotFound desc = could not find container \"bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2\": container with ID starting with bd3d139c02b09d543ef109835eedf3eb8e20f020244dd516436b1d28c8c31ea2 not found: ID does not exist"
May 27 21:42:42.258361 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.258338    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:42:42.262108 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.262083    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-857bdfbfcb-zzkk4"]
May 27 21:42:42.562904 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:42.562817    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05c1d4f-8bf8-4244-830e-71135c5663d7" path="/var/lib/kubelet/pods/c05c1d4f-8bf8-4244-830e-71135c5663d7/volumes"
May 27 21:42:44.218162 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:42:44.218129    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-vklv6"
May 27 21:44:58.574871 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:44:58.574841    2558 scope.go:117] "RemoveContainer" containerID="54ce059f98a003e3217291dc8fe391704032280a93779dcdf8c6a74e89f39807"
May 27 21:54:23.757722 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:23.757689    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:54:23.758276 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:23.757913    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" podUID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" containerName="manager" containerID="cri-o://70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1" gracePeriod=10
May 27 21:54:24.001710 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.001683    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:54:24.074248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.074154    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnc2j\" (UniqueName: \"kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j\") pod \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") "
May 27 21:54:24.074248 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.074210    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume\") pod \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\" (UID: \"aa5d30c6-5a97-4bdf-8290-732fc4d7e503\") "
May 27 21:54:24.074651 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.074626    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aa5d30c6-5a97-4bdf-8290-732fc4d7e503" (UID: "aa5d30c6-5a97-4bdf-8290-732fc4d7e503"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 27 21:54:24.076436 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.076403    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j" (OuterVolumeSpecName: "kube-api-access-pnc2j") pod "aa5d30c6-5a97-4bdf-8290-732fc4d7e503" (UID: "aa5d30c6-5a97-4bdf-8290-732fc4d7e503"). InnerVolumeSpecName "kube-api-access-pnc2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 27 21:54:24.175392 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.175360    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnc2j\" (UniqueName: \"kubernetes.io/projected/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-kube-api-access-pnc2j\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:54:24.175392 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.175388    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aa5d30c6-5a97-4bdf-8290-732fc4d7e503-extensions-socket-volume\") on node \"ip-10-0-138-159.ec2.internal\" DevicePath \"\""
May 27 21:54:24.568392 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.568355    2558 generic.go:358] "Generic (PLEG): container finished" podID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" containerID="70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1" exitCode=0
May 27 21:54:24.568564 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.568438    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"
May 27 21:54:24.568564 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.568442    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" event={"ID":"aa5d30c6-5a97-4bdf-8290-732fc4d7e503","Type":"ContainerDied","Data":"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"}
May 27 21:54:24.568564 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.568496    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg" event={"ID":"aa5d30c6-5a97-4bdf-8290-732fc4d7e503","Type":"ContainerDied","Data":"088f918f283350f99d3fe02ca786b3d956a2461a42191d228ac55a0a1610a974"}
May 27 21:54:24.568564 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.568512    2558 scope.go:117] "RemoveContainer" containerID="70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"
May 27 21:54:24.577088 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.577070    2558 scope.go:117] "RemoveContainer" containerID="70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"
May 27 21:54:24.577297 ip-10-0-138-159 kubenswrapper[2558]: E0527 21:54:24.577282    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1\": container with ID starting with 70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1 not found: ID does not exist" containerID="70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"
May 27 21:54:24.577341 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.577304    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1"} err="failed to get container status \"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1\": rpc error: code = NotFound desc = could not find container \"70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1\": container with ID starting with 70fe4fff9ec1bbd35294fe03b738a4d12352a0f8f2bb6d72428088d4d50c2ee1 not found: ID does not exist"
May 27 21:54:24.587228 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.587207    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:54:24.591864 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:24.591842    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8thdg"]
May 27 21:54:26.562841 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:54:26.562807    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" path="/var/lib/kubelet/pods/aa5d30c6-5a97-4bdf-8290-732fc4d7e503/volumes"
May 27 21:55:29.878603 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.878564    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"]
May 27 21:55:29.879731 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879691    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05c1d4f-8bf8-4244-830e-71135c5663d7" containerName="authorino"
May 27 21:55:29.879731 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879734    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05c1d4f-8bf8-4244-830e-71135c5663d7" containerName="authorino"
May 27 21:55:29.879901 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879749    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" containerName="manager"
May 27 21:55:29.879901 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879758    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" containerName="manager"
May 27 21:55:29.880003 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879916    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="c05c1d4f-8bf8-4244-830e-71135c5663d7" containerName="authorino"
May 27 21:55:29.880003 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.879929    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa5d30c6-5a97-4bdf-8290-732fc4d7e503" containerName="manager"
May 27 21:55:29.884400 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.883505    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:29.887214 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.887196    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6wcbq\""
May 27 21:55:29.902636 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.902599    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"]
May 27 21:55:29.935919 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.935890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4kq5\" (UniqueName: \"kubernetes.io/projected/4929a350-62ce-4b0f-b49b-f473955f1d64-kube-api-access-v4kq5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:29.936062 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:29.935929    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4929a350-62ce-4b0f-b49b-f473955f1d64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.036513 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.036481    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4kq5\" (UniqueName: \"kubernetes.io/projected/4929a350-62ce-4b0f-b49b-f473955f1d64-kube-api-access-v4kq5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.036513 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.036519    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4929a350-62ce-4b0f-b49b-f473955f1d64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.036882 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.036862    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4929a350-62ce-4b0f-b49b-f473955f1d64-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.046221 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.046195    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4kq5\" (UniqueName: \"kubernetes.io/projected/4929a350-62ce-4b0f-b49b-f473955f1d64-kube-api-access-v4kq5\") pod \"kuadrant-operator-controller-manager-55c7f4c975-f6r4n\" (UID: \"4929a350-62ce-4b0f-b49b-f473955f1d64\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.193849 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.193815    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.330724 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.330697    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"]
May 27 21:55:30.333090 ip-10-0-138-159 kubenswrapper[2558]: W0527 21:55:30.333062    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4929a350_62ce_4b0f_b49b_f473955f1d64.slice/crio-386207461c242b102c18035aad142c9f0cbdd9cf0818274830b402d6cc84b3b1 WatchSource:0}: Error finding container 386207461c242b102c18035aad142c9f0cbdd9cf0818274830b402d6cc84b3b1: Status 404 returned error can't find the container with id 386207461c242b102c18035aad142c9f0cbdd9cf0818274830b402d6cc84b3b1
May 27 21:55:30.336013 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.335997    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 21:55:30.778158 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.778119    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n" event={"ID":"4929a350-62ce-4b0f-b49b-f473955f1d64","Type":"ContainerStarted","Data":"1e7f56d845ba4ccc92c4a80e20538601a279f638aa22a134b7597cab04bc26ab"}
May 27 21:55:30.778158 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.778159    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n" event={"ID":"4929a350-62ce-4b0f-b49b-f473955f1d64","Type":"ContainerStarted","Data":"386207461c242b102c18035aad142c9f0cbdd9cf0818274830b402d6cc84b3b1"}
May 27 21:55:30.778367 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.778200    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 21:55:30.798971 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:30.798926    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n" podStartSLOduration=1.798910332 podStartE2EDuration="1.798910332s" podCreationTimestamp="2026-05-27 21:55:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 21:55:30.797139622 +0000 UTC m=+1652.824958843" watchObservedRunningTime="2026-05-27 21:55:30.798910332 +0000 UTC m=+1652.826729540"
May 27 21:55:41.784640 ip-10-0-138-159 kubenswrapper[2558]: I0527 21:55:41.784585    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-f6r4n"
May 27 22:05:17.522054 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:17.521974    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cc555bf-9slvx_2154823e-0478-41c4-b05b-0c6891054007/authorino/0.log"
May 27 22:05:21.998224 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:21.998187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d9548bf9c-x4xlr_c4a21bb1-5bc8-4a56-8932-957ea7e07128/maas-api/0.log"
May 27 22:05:22.559380 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:22.559329    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d799877b9-6672q_3b11e93e-a563-4e49-b809-c73845bc8ba1/manager/0.log"
May 27 22:05:22.928566 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:22.928494    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6n72f_d72f7760-6561-410c-b1bf-8df7d87705b4/postgres/0.log"
May 27 22:05:24.239116 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:24.239083    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cc555bf-9slvx_2154823e-0478-41c4-b05b-0c6891054007/authorino/0.log"
May 27 22:05:24.500607 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:24.500519    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-pqsqm_38c320f9-5946-4068-be83-d6dde0801d32/manager/0.log"
May 27 22:05:24.729934 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:24.729896    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-trhsk_7df2396c-1f1e-42db-9cfb-5243fcc1092a/registry-server/0.log"
May 27 22:05:24.848734 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:24.848652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-f6r4n_4929a350-62ce-4b0f-b49b-f473955f1d64/manager/0.log"
May 27 22:05:25.419561 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:25.419532    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blgxp8_31437f51-bbb8-4ca9-a5b2-87219ad88f9c/istio-proxy/0.log"
May 27 22:05:25.873257 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:25.873224    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-jvclc_a5b6e51d-643d-47d4-bd4d-09cbba998fe4/istio-proxy/0.log"
May 27 22:05:26.430067 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.430037    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b_f9a401a5-2b23-42bf-8a25-3bcc3926a947/main/0.log"
May 27 22:05:26.436811 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.436773    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-vvt8b_f9a401a5-2b23-42bf-8a25-3bcc3926a947/storage-initializer/0.log"
May 27 22:05:26.656825 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.656793    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-vklv6_0be2df01-d096-4eec-9ea3-2d016cba4caa/main/0.log"
May 27 22:05:26.663484 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.663455    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-vklv6_0be2df01-d096-4eec-9ea3-2d016cba4caa/storage-initializer/0.log"
May 27 22:05:26.775243 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.775215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn_264f760a-03cb-4860-b6e5-987af6199821/storage-initializer/0.log"
May 27 22:05:26.782562 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:26.782539    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7gftn_264f760a-03cb-4860-b6e5-987af6199821/main/0.log"
May 27 22:05:31.199543 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.199503    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-77md2/must-gather-xz7n4"]
May 27 22:05:31.202790 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.202772    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.205445 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.205420    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77md2\"/\"kube-root-ca.crt\""
May 27 22:05:31.213179 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.213159    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-77md2\"/\"default-dockercfg-84qd4\""
May 27 22:05:31.213282 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.213226    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-77md2\"/\"openshift-service-ca.crt\""
May 27 22:05:31.233527 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.233501    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/must-gather-xz7n4"]
May 27 22:05:31.385232 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.385190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43567744-4f22-43f2-ba1b-e98c503bf16d-must-gather-output\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.385403 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.385249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4f2w\" (UniqueName: \"kubernetes.io/projected/43567744-4f22-43f2-ba1b-e98c503bf16d-kube-api-access-b4f2w\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.486584 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.486497    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43567744-4f22-43f2-ba1b-e98c503bf16d-must-gather-output\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.486584 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.486538    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4f2w\" (UniqueName: \"kubernetes.io/projected/43567744-4f22-43f2-ba1b-e98c503bf16d-kube-api-access-b4f2w\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.486883 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.486861    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/43567744-4f22-43f2-ba1b-e98c503bf16d-must-gather-output\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.494910 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.494878    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4f2w\" (UniqueName: \"kubernetes.io/projected/43567744-4f22-43f2-ba1b-e98c503bf16d-kube-api-access-b4f2w\") pod \"must-gather-xz7n4\" (UID: \"43567744-4f22-43f2-ba1b-e98c503bf16d\") " pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.511838 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.511810    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/must-gather-xz7n4"
May 27 22:05:31.651990 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.651957    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/must-gather-xz7n4"]
May 27 22:05:31.655306 ip-10-0-138-159 kubenswrapper[2558]: W0527 22:05:31.655275    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43567744_4f22_43f2_ba1b_e98c503bf16d.slice/crio-06cf412e4b2254081c767f9677d5bdd88c8cdaa377dca5fc8b3d402fa7c5c109 WatchSource:0}: Error finding container 06cf412e4b2254081c767f9677d5bdd88c8cdaa377dca5fc8b3d402fa7c5c109: Status 404 returned error can't find the container with id 06cf412e4b2254081c767f9677d5bdd88c8cdaa377dca5fc8b3d402fa7c5c109
May 27 22:05:31.656956 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.656939    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 27 22:05:31.741128 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:31.741041    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/must-gather-xz7n4" event={"ID":"43567744-4f22-43f2-ba1b-e98c503bf16d","Type":"ContainerStarted","Data":"06cf412e4b2254081c767f9677d5bdd88c8cdaa377dca5fc8b3d402fa7c5c109"}
May 27 22:05:32.749129 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:32.749091    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/must-gather-xz7n4" event={"ID":"43567744-4f22-43f2-ba1b-e98c503bf16d","Type":"ContainerStarted","Data":"62f30f7d63351eabefb53474948bad92714301d8c0d1e393d42fe0180dcb47d8"}
May 27 22:05:32.749481 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:32.749137    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/must-gather-xz7n4" event={"ID":"43567744-4f22-43f2-ba1b-e98c503bf16d","Type":"ContainerStarted","Data":"577a56ff7091e21574eccc70e18c10f34f0424d52261aa7a2154822df4975818"}
May 27 22:05:32.765970 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:32.765859    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-77md2/must-gather-xz7n4" podStartSLOduration=0.917099094 podStartE2EDuration="1.7658433s" podCreationTimestamp="2026-05-27 22:05:31 +0000 UTC" firstStartedPulling="2026-05-27 22:05:31.657069162 +0000 UTC m=+2253.684888350" lastFinishedPulling="2026-05-27 22:05:32.505813356 +0000 UTC m=+2254.533632556" observedRunningTime="2026-05-27 22:05:32.76473196 +0000 UTC m=+2254.792551169" watchObservedRunningTime="2026-05-27 22:05:32.7658433 +0000 UTC m=+2254.793662512"
May 27 22:05:34.162269 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:34.162238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bthvn_03e14bc4-fa47-4c13-833b-9e729aedf442/global-pull-secret-syncer/0.log"
May 27 22:05:34.276064 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:34.276034    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f42f9_495058c8-d1d1-4db5-89c1-8e457294f2cc/konnectivity-agent/0.log"
May 27 22:05:34.405421 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:34.405392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-159.ec2.internal_39b57b60eeeca70eb09bd98253b12281/haproxy/0.log"
May 27 22:05:38.656810 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:38.656773    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cc555bf-9slvx_2154823e-0478-41c4-b05b-0c6891054007/authorino/0.log"
May 27 22:05:38.736948 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:38.736917    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-pqsqm_38c320f9-5946-4068-be83-d6dde0801d32/manager/0.log"
May 27 22:05:38.829309 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:38.829273    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-trhsk_7df2396c-1f1e-42db-9cfb-5243fcc1092a/registry-server/0.log"
May 27 22:05:38.927909 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:38.927815    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-f6r4n_4929a350-62ce-4b0f-b49b-f473955f1d64/manager/0.log"
May 27 22:05:40.923517 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:40.923491    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/node-exporter/0.log"
May 27 22:05:40.946357 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:40.946330    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/kube-rbac-proxy/0.log"
May 27 22:05:40.972863 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:40.972825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dcbs_05893244-630b-42f6-92c8-d80fb002bec2/init-textfile/0.log"
May 27 22:05:42.839799 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:42.839728    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-z6nkk_6501eee3-044c-4f2a-98b1-fbcb73685ada/networking-console-plugin/0.log"
May 27 22:05:43.122776 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.122698    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"]
May 27 22:05:43.132758 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.132727    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.140127 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.140085    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"]
May 27 22:05:43.205935 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.205885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-lib-modules\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.206105 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.205989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-sys\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.206105 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.206027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-proc\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.206105 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.206046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-podres\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.206105 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.206068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd4z7\" (UniqueName: \"kubernetes.io/projected/e743bbab-2ca6-480d-9ba7-5df8bddf9605-kube-api-access-kd4z7\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307125 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307091    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-podres\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307125 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307130    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kd4z7\" (UniqueName: \"kubernetes.io/projected/e743bbab-2ca6-480d-9ba7-5df8bddf9605-kube-api-access-kd4z7\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307174    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-lib-modules\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307217    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-sys\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307248    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-proc\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307291    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-podres\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307307    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-sys\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307329    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-proc\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.307376 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.307347    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e743bbab-2ca6-480d-9ba7-5df8bddf9605-lib-modules\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.316162 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.316124    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd4z7\" (UniqueName: \"kubernetes.io/projected/e743bbab-2ca6-480d-9ba7-5df8bddf9605-kube-api-access-kd4z7\") pod \"perf-node-gather-daemonset-tq6rh\" (UID: \"e743bbab-2ca6-480d-9ba7-5df8bddf9605\") " pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.460914 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.460872    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.642501 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.642407    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"]
May 27 22:05:43.646596 ip-10-0-138-159 kubenswrapper[2558]: W0527 22:05:43.646561    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode743bbab_2ca6_480d_9ba7_5df8bddf9605.slice/crio-3d41d345ddc8f857cfbbf5faf734c1cb4dd5978fa07068f80e869ec224d9beb7 WatchSource:0}: Error finding container 3d41d345ddc8f857cfbbf5faf734c1cb4dd5978fa07068f80e869ec224d9beb7: Status 404 returned error can't find the container with id 3d41d345ddc8f857cfbbf5faf734c1cb4dd5978fa07068f80e869ec224d9beb7
May 27 22:05:43.799147 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.799097    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh" event={"ID":"e743bbab-2ca6-480d-9ba7-5df8bddf9605","Type":"ContainerStarted","Data":"236673f06443ee1f850347b45aae883133f9311bfe0d864f4444205c0658c493"}
May 27 22:05:43.799147 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.799150    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh" event={"ID":"e743bbab-2ca6-480d-9ba7-5df8bddf9605","Type":"ContainerStarted","Data":"3d41d345ddc8f857cfbbf5faf734c1cb4dd5978fa07068f80e869ec224d9beb7"}
May 27 22:05:43.799856 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.799833    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:43.816846 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:43.816802    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh" podStartSLOduration=0.816787228 podStartE2EDuration="816.787228ms" podCreationTimestamp="2026-05-27 22:05:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-27 22:05:43.816672019 +0000 UTC m=+2265.844491230" watchObservedRunningTime="2026-05-27 22:05:43.816787228 +0000 UTC m=+2265.844606437"
May 27 22:05:45.364125 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:45.364098    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjsjf_cd71dd77-9b8b-4e7c-808a-66f8403e3dab/dns/0.log"
May 27 22:05:45.387930 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:45.387913    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjsjf_cd71dd77-9b8b-4e7c-808a-66f8403e3dab/kube-rbac-proxy/0.log"
May 27 22:05:45.411660 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:45.411636    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cl522_acf4e49c-cfdb-4ab2-8462-b3f90924f126/dns-node-resolver/0.log"
May 27 22:05:45.964100 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:45.964060    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cd4wq_01b52d0d-16d1-46ad-8ffc-3708ff474d04/node-ca/0.log"
May 27 22:05:46.862223 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:46.862195    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4blgxp8_31437f51-bbb8-4ca9-a5b2-87219ad88f9c/istio-proxy/0.log"
May 27 22:05:47.085783 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:47.085731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-jvclc_a5b6e51d-643d-47d4-bd4d-09cbba998fe4/istio-proxy/0.log"
May 27 22:05:47.705273 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:47.705242    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8b9tz_8619c2a1-ef70-410d-9b6b-5491ee9974d7/serve-healthcheck-canary/0.log"
May 27 22:05:48.343625 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:48.343583    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp2b2_a6c51d24-7765-402a-be6e-55838f4fbf45/kube-rbac-proxy/0.log"
May 27 22:05:48.368189 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:48.368156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp2b2_a6c51d24-7765-402a-be6e-55838f4fbf45/exporter/0.log"
May 27 22:05:48.389634 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:48.389598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kp2b2_a6c51d24-7765-402a-be6e-55838f4fbf45/extractor/0.log"
May 27 22:05:50.411677 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:50.411648    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5d9548bf9c-x4xlr_c4a21bb1-5bc8-4a56-8932-957ea7e07128/maas-api/0.log"
May 27 22:05:50.617788 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:50.617755    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d799877b9-6672q_3b11e93e-a563-4e49-b809-c73845bc8ba1/manager/0.log"
May 27 22:05:50.712072 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:50.712040    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6n72f_d72f7760-6561-410c-b1bf-8df7d87705b4/postgres/0.log"
May 27 22:05:50.818820 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:50.818794    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-77md2/perf-node-gather-daemonset-tq6rh"
May 27 22:05:52.002245 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:52.002201    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7bff7fcbc9-vznl8_0f525b13-e8ae-4992-90e0-42266a527aa0/manager/0.log"
May 27 22:05:57.884812 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:57.884777    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4jggt_089c39ef-3460-472d-98e8-488986450b10/kube-multus/0.log"
May 27 22:05:58.057007 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.056976    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/kube-multus-additional-cni-plugins/0.log"
May 27 22:05:58.077524 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.077495    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/egress-router-binary-copy/0.log"
May 27 22:05:58.096406 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.096379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/cni-plugins/0.log"
May 27 22:05:58.114758 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.114731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/bond-cni-plugin/0.log"
May 27 22:05:58.133470 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.133445    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/routeoverride-cni/0.log"
May 27 22:05:58.152101 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.152033    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/whereabouts-cni-bincopy/0.log"
May 27 22:05:58.170118 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.170092    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fv45z_02e3acb1-bd19-4356-ac08-690841ffbf76/whereabouts-cni/0.log"
May 27 22:05:58.397644 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.397601    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vqzh_0e37582f-501f-48e0-ace0-4f5640789b07/network-metrics-daemon/0.log"
May 27 22:05:58.415178 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:58.415109    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2vqzh_0e37582f-501f-48e0-ace0-4f5640789b07/kube-rbac-proxy/0.log"
May 27 22:05:59.870752 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:59.870722    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vv2w4_85d1deaa-c52f-4620-8b3e-d880165f7fdf/ovn-controller/0.log"
May 27 22:05:59.911750 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:59.911723    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vv2w4_85d1deaa-c52f-4620-8b3e-d880165f7fdf/ovn-acl-logging/0.log"
May 27 22:05:59.937604 ip-10-0-138-159 kubenswrapper[2558]: I0527 22:05:59.937535    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vv2w4_85d1deaa-c52f-4620-8b3e-d880165f7fdf/kube-rbac-proxy-node/0.log"