May 28 18:22:56.637695 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 18:22:56.637707 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 18:22:56.637714 ip-10-0-139-21 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 18:22:56.637937 ip-10-0-139-21 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 18:23:06.672569 ip-10-0-139-21 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 18:23:06.672585 ip-10-0-139-21 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 70b589883132446e9b683c3bdb8e0dc1 --
May 28 18:26:01.185065 ip-10-0-139-21 systemd[1]: Starting Kubernetes Kubelet...
May 28 18:26:01.622015 ip-10-0-139-21 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:01.622015 ip-10-0-139-21 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 18:26:01.622015 ip-10-0-139-21 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:01.622015 ip-10-0-139-21 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 18:26:01.622015 ip-10-0-139-21 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:26:01.623546 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.623456    2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 18:26:01.626111 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626096    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:01.626111 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626111    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626115    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626118    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626121    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626125    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626128    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626130    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626134    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626137    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626139    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626147    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626151    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626154    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626156    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626159    2574 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626162    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626165    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626167    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626170    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626173    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:01.626173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626175    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626179    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626182    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626184    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626187    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626190    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626192    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626195    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626198    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626200    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626203    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626206    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626208    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626211    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626213    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626216    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626218    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626221    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626223    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626226    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:01.626812 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626228    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626231    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626233    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626236    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626239    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626241    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626244    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626247    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626250    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626254    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626258    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626261    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626264    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626266    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626272    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626276    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626280    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626283    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626285    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:01.627544 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626288    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626291    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626293    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626296    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626298    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626300    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626303    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626305    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626308    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626310    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626313    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626316    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626318    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626321    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626324    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626327    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626329    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626372    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626409    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626414    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:01.628031 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626419    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626423    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626428    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626432    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626437    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.626442    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627833    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627843    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627846    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627849    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627853    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627855    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627858    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627861    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627865    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627867    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627870    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627873    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627876    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:01.628507 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627879    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627881    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627884    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627886    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627889    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627891    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627894    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627896    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627899    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627901    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627904    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627907    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627909    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627911    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627914    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627917    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627919    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627922    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627924    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627927    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:01.628970 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627930    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627933    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627935    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627938    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627940    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627943    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627945    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627949    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627952    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627955    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627959    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627963    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627966    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627969    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627972    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627974    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627977    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627980    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627982    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:01.629491 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627985    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627987    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627990    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627992    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627995    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.627998    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628001    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628003    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628006    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628008    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628011    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628013    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628016    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628018    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628021    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628025    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628029    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628032    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628034    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:01.629974 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628037    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628041    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628045    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628048    2574 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628051    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628053    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628056    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628059    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628061    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628064    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628066    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628069    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628071    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628074    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628076    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628148    2574 flags.go:64] FLAG: --address="0.0.0.0"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628158    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628168    2574 flags.go:64] FLAG: --anonymous-auth="true"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628175    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628181    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628186    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 18:26:01.630444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628192    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628197    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628201    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628204    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628207    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628210    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628213    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628217    2574 flags.go:64] FLAG: --cgroup-root=""
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628220    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628222    2574 flags.go:64] FLAG: --client-ca-file=""
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628226    2574 flags.go:64] FLAG: --cloud-config=""
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628228    2574 flags.go:64] FLAG: --cloud-provider="external"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628233    2574 flags.go:64] FLAG: --cluster-dns="[]"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628238    2574 flags.go:64] FLAG: --cluster-domain=""
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628241    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628245    2574 flags.go:64] FLAG: --config-dir=""
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628247    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628251    2574 flags.go:64] FLAG: --container-log-max-files="5"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628255    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628258    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628261    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628264    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628267    2574 flags.go:64] FLAG: --contention-profiling="false"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628270    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 18:26:01.630961 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628273    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628277    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628280    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628289    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628292    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628295    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628298    2574 flags.go:64] FLAG: --enable-load-reader="false"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628301    2574 flags.go:64] FLAG: --enable-server="true"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628304    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628309    2574 flags.go:64] FLAG: --event-burst="100"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628311    2574 flags.go:64] FLAG: --event-qps="50"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628314    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628317    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628320    2574 flags.go:64] FLAG: --eviction-hard=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628324    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628326    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628330    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628333    2574 flags.go:64] FLAG: --eviction-soft=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628337    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628340    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628344    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628347    2574 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628350    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628352    2574 flags.go:64] FLAG: --fail-swap-on="true"
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628355    2574 flags.go:64] FLAG: --feature-gates=""
May 28 18:26:01.631580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628359    2574 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628362    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628365    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628369    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628372    2574 flags.go:64] FLAG: --healthz-port="10248"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628375    2574 flags.go:64] FLAG: --help="false"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628377    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-139-21.ec2.internal"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628380    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628383    2574 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628386    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628390    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628393    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628396    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628403    2574 flags.go:64] FLAG: --image-service-endpoint=""
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628406    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628409    2574 flags.go:64] FLAG: --kube-api-burst="100"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628412    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628415    2574 flags.go:64] FLAG: --kube-api-qps="50"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628418    2574 flags.go:64] FLAG: --kube-reserved=""
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628421    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628424    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628427    2574 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628430    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628433    2574 flags.go:64] FLAG: --lock-file=""
May 28 18:26:01.632219 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628436    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628439    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628442    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628448    2574 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628451    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628454    2574 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628457    2574 flags.go:64] FLAG: --logging-format="text"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628460    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628464    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628466    2574 flags.go:64] FLAG: --manifest-url=""
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628469    2574 flags.go:64] FLAG: --manifest-url-header=""
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628474    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628476    2574 flags.go:64] FLAG: --max-open-files="1000000"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628480    2574 flags.go:64] FLAG: --max-pods="110"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628483    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628486    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628489    2574 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628492    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628495    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628498    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628503    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628511    2574 flags.go:64] FLAG: --node-status-max-images="50"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628514    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628517    2574 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 18:26:01.632810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628521    2574 flags.go:64] FLAG: --pod-cidr=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628524    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628529    2574 flags.go:64] FLAG: --pod-manifest-path=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628532    2574 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628535    2574 flags.go:64] FLAG: --pods-per-core="0"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628538    2574 flags.go:64] FLAG: --port="10250"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628541    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628545    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-000e8c905b440f668"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628548    2574 flags.go:64] FLAG: --qos-reserved=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628551    2574 flags.go:64] FLAG: --read-only-port="10255"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628554    2574 flags.go:64] FLAG: --register-node="true"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628557    2574 flags.go:64] FLAG: --register-schedulable="true"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628560    2574 flags.go:64] FLAG: --register-with-taints=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628564    2574 flags.go:64] FLAG: --registry-burst="10"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628567    2574 flags.go:64] FLAG: --registry-qps="5"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628570    2574 flags.go:64] FLAG: --reserved-cpus=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628572    2574 flags.go:64] FLAG: --reserved-memory=""
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628576    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628579    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628582    2574 flags.go:64] FLAG: --rotate-certificates="false"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628585    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628588    2574 flags.go:64] FLAG: --runonce="false"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628591    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628594    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628596    2574 flags.go:64] FLAG: --seccomp-default="false"
May 28 18:26:01.633399 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628600    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628603    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628606    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628610    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628613    2574 flags.go:64] FLAG: --storage-driver-password="root"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628617    2574 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628620    2574 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628623    2574 flags.go:64] FLAG: --storage-driver-user="root"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628626    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628629    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628632    2574 flags.go:64] FLAG: --system-cgroups=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628635    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628640    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628643    2574 flags.go:64] FLAG: --tls-cert-file=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628646    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628650    2574 flags.go:64] FLAG: --tls-min-version=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628653    2574 flags.go:64] FLAG: --tls-private-key-file=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628656    2574 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628659    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628663    2574 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628666    2574 flags.go:64] FLAG: --v="2"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628670    2574 flags.go:64] FLAG: --version="false"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628674    2574 flags.go:64] FLAG: --vmodule=""
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628678    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.628681    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 18:26:01.634045 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628784    2574 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628800    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628804    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628807    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628810    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628813    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628816    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628819    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628822    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628825    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628833    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628836    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628840    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628843    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628846    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628848    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628851    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628853    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628856    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628859    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:01.634665 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628861    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628864    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628866    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628869    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628872    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628875    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628878    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628881    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628883    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628886    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628889    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628891    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628894    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628896    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628899    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628901    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628904    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628906    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628909    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:01.635210 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628911    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628914    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628916    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628920    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628923    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628927    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628930    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628932    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628935    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628937    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628940    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628942    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628945    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628949    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628953    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628956    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628959    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628962    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628964    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628967    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:01.635692 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628970    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628974    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628977    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628980    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628983    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628986    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628988    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628991    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628993    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628996    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.628998    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629001    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629003    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629006    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629008    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629012    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629015    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629018    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629021    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:01.636215 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629024    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629027    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629031    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629034    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629037    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629039    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629042    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.629044    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.629049    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.636807    2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.636825    2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636876    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636881    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636885    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636888    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:01.637288 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636892    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636897    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636900    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636903    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636907    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636910    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636913    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636915    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636918    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636921    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636923    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636926    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636929    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636932    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636934    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636937    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636939    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636942    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636944    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636947    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:01.637681 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636949    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636952    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636955    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636957    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636960    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636962    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636965    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636968    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636971    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636973    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636977    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636981    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636987    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636990    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636993    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636996    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.636999    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637002    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637005    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:01.638177 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637009    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637012    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637014    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637017    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637021    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637023    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637026    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637029    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637031    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637034    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637036    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637039    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637041    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637044    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637046    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637049    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637052    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637054    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637057    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:01.638635 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637059    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637062    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637065    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637068    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637071    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637088    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637092    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637096    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637099    2574 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637102    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637105    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637108    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637111    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637114    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637117    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637120    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637123    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637125    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637128    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637130    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:01.639137 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637133    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637136    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637138    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637141    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.637146    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637240    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637245    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637248    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637252    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637256    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637259    2574 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637262    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637264    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637268    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637271    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:26:01.639628 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637273    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637276    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637279    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637281    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637284    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637287    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637290    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637293    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637295    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637298    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637313    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637316    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637319    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637322    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637325    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637328    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637331    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637334    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637337    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:26:01.640026 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637339    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637342    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637344    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637347    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637350    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637352    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637355    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637357    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637360    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637362    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637365    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637368    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637371    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637374    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637377    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637379    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637382    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637384    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637387    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637390    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:26:01.640490 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637392    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637395    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637397    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637400    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637402    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637405    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637407    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637409    2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637412    2574 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637416    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637419    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637422    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637424    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637426    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637429    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637431    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637434    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637437    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637439    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:26:01.641097 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637441    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637444    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637447    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637449    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637451    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637454    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637457    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637460    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637462    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637465    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637467    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637470    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637472    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637475    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637478    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637480    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637483    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:26:01.641559 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:01.637485    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:26:01.641980 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.637490    2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:26:01.641980 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.638297    2574 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 18:26:01.643031 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.643017    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 18:26:01.643978 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.643967    2574 server.go:1019] "Starting client certificate rotation"
May 28 18:26:01.644083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.644066    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:26:01.644123 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.644099    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:26:01.669949 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.669929    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:26:01.672237 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.672217    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:26:01.683511 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.683487    2574 log.go:25] "Validated CRI v1 runtime API"
May 28 18:26:01.689141 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.689123    2574 log.go:25] "Validated CRI v1 image API"
May 28 18:26:01.690362 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.690347    2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 18:26:01.695257 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.695229    2574 fs.go:135] Filesystem UUIDs: map[77aeb41a-12a1-4ce0-a731-d5ddaa872307:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7eaf0896-fe30-4f02-860b-44074df3ec6d:/dev/nvme0n1p4]
May 28 18:26:01.695309 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.695252    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 18:26:01.698023 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.698009    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:26:01.699580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.699449    2574 manager.go:217] Machine: {Timestamp:2026-05-28 18:26:01.698925969 +0000 UTC m=+0.399402952 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3140539 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e672aa92fd04cdddaceaa2ed1432 SystemUUID:ec24e672-aa92-fd04-cddd-aceaa2ed1432 BootID:70b58988-3132-446e-9b68-3c3bdb8e0dc1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3b:d6:c3:96:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3b:d6:c3:96:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:f5:70:1b:64:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 18:26:01.700965 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.700952    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 18:26:01.701067 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.701049    2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 18:26:01.703002 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.702972    2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 18:26:01.703138 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.703005    2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-21.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 18:26:01.703180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.703148    2574 topology_manager.go:138] "Creating topology manager with none policy"
May 28 18:26:01.703180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.703155    2574 container_manager_linux.go:306] "Creating device plugin manager"
May 28 18:26:01.703180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.703163    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:26:01.703950 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.703940    2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:26:01.705846 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.705836    2574 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:26:01.705967 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.705958    2574 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 18:26:01.708333 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.708320    2574 kubelet.go:491] "Attempting to sync node with API server"
May 28 18:26:01.708378 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.708337    2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 18:26:01.708378 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.708350    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 18:26:01.708378 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.708360    2574 kubelet.go:397] "Adding apiserver pod source"
May 28 18:26:01.708378 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.708370    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 18:26:01.710360 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.710347    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:26:01.710402 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.710368    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:26:01.713917 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.713898    2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 18:26:01.715591 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.715577    2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 18:26:01.716438 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716427    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716444    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716451    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716457    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716466    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716472    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716477    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 18:26:01.716480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716483    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 18:26:01.716672 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716490    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 18:26:01.716672 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716496    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 18:26:01.716672 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716509    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 18:26:01.716672 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.716660    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 18:26:01.717389 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.717368    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 18:26:01.717389 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.717382    2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 18:26:01.720674 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.720660    2574 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 18:26:01.720728 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.720698    2574 server.go:1295] "Started kubelet"
May 28 18:26:01.720783 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.720741    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 18:26:01.720863 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.720822    2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 18:26:01.720896 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.720882    2574 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 18:26:01.721557 ip-10-0-139-21 systemd[1]: Started Kubernetes Kubelet.
May 28 18:26:01.722437 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.721954    2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 18:26:01.722437 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.722356    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 18:26:01.722437 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.722372    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 18:26:01.722437 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.722433    2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-21.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 18:26:01.722954 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.722941    2574 server.go:317] "Adding debug handlers to kubelet server"
May 28 18:26:01.727752 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.727731    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 18:26:01.727950 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.726703    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18b3cdfc69209a33  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-05-28 18:26:01.720674867 +0000 UTC m=+0.421151849,LastTimestamp:2026-05-28 18:26:01.720674867 +0000 UTC m=+0.421151849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
May 28 18:26:01.728271 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.728254    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 18:26:01.728695 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.728682    2574 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 18:26:01.728820 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.728809    2574 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 18:26:01.730326 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.730287    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:01.730407 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.730292    2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 18:26:01.730691 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.730671    2574 factory.go:55] Registering systemd factory
May 28 18:26:01.730691 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.730690    2574 factory.go:223] Registration of the systemd container factory successfully
May 28 18:26:01.731772 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.731756    2574 reconstruct.go:97] "Volume reconstruction finished"
May 28 18:26:01.731904 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.731892    2574 reconciler.go:26] "Reconciler: start to sync state"
May 28 18:26:01.732182 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.732170    2574 factory.go:153] Registering CRI-O factory
May 28 18:26:01.732278 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.732263    2574 factory.go:223] Registration of the crio container factory successfully
May 28 18:26:01.732383 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.732374    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 18:26:01.732459 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.732451    2574 factory.go:103] Registering Raw factory
May 28 18:26:01.732534 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.732528    2574 manager.go:1196] Started watching for new ooms in manager
May 28 18:26:01.733209 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.733189    2574 manager.go:319] Starting recovery of all containers
May 28 18:26:01.735219 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.735180    2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 18:26:01.735472 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.735451    2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 18:26:01.735578 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.735460    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-21.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 18:26:01.738573 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.738543    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 18:26:01.745193 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.745015    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bk69f"
May 28 18:26:01.745193 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.745028    2574 manager.go:324] Recovery completed
May 28 18:26:01.749246 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.749231    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.749929 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.749915    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bk69f"
May 28 18:26:01.751095 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751080    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.751162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751108    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.751162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751118    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:01.751678 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751664    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 18:26:01.751678 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751677    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 18:26:01.751760 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.751694    2574 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:26:01.752940 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.752874    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-21.ec2.internal.18b3cdfc6af0c971  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-21.ec2.internal,UID:ip-10-0-139-21.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-21.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-21.ec2.internal,},FirstTimestamp:2026-05-28 18:26:01.751095665 +0000 UTC m=+0.451572648,LastTimestamp:2026-05-28 18:26:01.751095665 +0000 UTC m=+0.451572648,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-21.ec2.internal,}"
May 28 18:26:01.756064 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.756050    2574 policy_none.go:49] "None policy: Start"
May 28 18:26:01.756123 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.756068    2574 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 18:26:01.756123 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.756078    2574 state_mem.go:35] "Initializing new in-memory state store"
May 28 18:26:01.800314 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800301    2574 manager.go:341] "Starting Device Plugin manager"
May 28 18:26:01.800432 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.800331    2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 18:26:01.800432 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800340    2574 server.go:85] "Starting device plugin registration server"
May 28 18:26:01.800565 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800554    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 18:26:01.800617 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800566    2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 18:26:01.800666 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800650    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 18:26:01.800753 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800739    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 18:26:01.800753 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.800752    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 18:26:01.801329 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.801309    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 18:26:01.801420 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.801344    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:01.869008 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.868976    2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 18:26:01.869008 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.869015    2574 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 18:26:01.869194 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.869037    2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 18:26:01.869194 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.869046    2574 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 18:26:01.869194 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.869089    2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 18:26:01.876043 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.875988    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:01.901207 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.901186    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.902346 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.902331    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.902414 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.902361    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.902414 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.902374    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:01.902498 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.902433    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-21.ec2.internal"
May 28 18:26:01.911451 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.911437    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-21.ec2.internal"
May 28 18:26:01.911506 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.911459    2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-21.ec2.internal\": node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:01.936345 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:01.936324    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:01.969345 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.969315    2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"]
May 28 18:26:01.969419 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.969395    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.970228 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.970212    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.970301 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.970239    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.970301 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.970249    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:01.971448 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.971436    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.971652 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.971638    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:01.971704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.971669    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.972518 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972495    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.972631 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972553    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.972631 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972594    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:01.972742 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972635    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.972742 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972685    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.972742 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.972714    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:01.974498 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.974481    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:01.974584 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.974508    2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:26:01.975172 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.975155    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:26:01.975258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.975181    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:26:01.975258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:01.975193    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeHasSufficientPID"
May 28 18:26:02.004632 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.004610    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-21.ec2.internal\" not found" node="ip-10-0-139-21.ec2.internal"
May 28 18:26:02.008916 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.008896    2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-21.ec2.internal\" not found" node="ip-10-0-139-21.ec2.internal"
May 28 18:26:02.034068 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.034041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db1aebaf26e9365f9d0caa1f85512259-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"db1aebaf26e9365f9d0caa1f85512259\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.034164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.034072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.034164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.034089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.037142 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.037120    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.134435 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134347    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.134435 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134391    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.134594 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134440    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.134594 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134460    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db1aebaf26e9365f9d0caa1f85512259-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"db1aebaf26e9365f9d0caa1f85512259\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.134594 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134495    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/db1aebaf26e9365f9d0caa1f85512259-config\") pod \"kube-apiserver-proxy-ip-10-0-139-21.ec2.internal\" (UID: \"db1aebaf26e9365f9d0caa1f85512259\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.134594 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.134525    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/686ae0ccb4c85238b2f28e4a7df4d900-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal\" (UID: \"686ae0ccb4c85238b2f28e4a7df4d900\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.137395 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.137381    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.238322 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.238298    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.307525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.307481    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.311217 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.311200    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:02.339289 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.339266    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.439933 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.439857    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.540515 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.540470    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.641242 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.641207    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.643304 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.643287    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 18:26:02.643440 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.643425    2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:26:02.714545 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.714469    2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:02.720522 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.720502    2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:02.727887 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.727867    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 18:26:02.738921 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.738900    2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:26:02.741595 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.741580    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.752704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.752677    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:21:01 +0000 UTC" deadline="2027-12-22 10:43:34.395179123 +0000 UTC"
May 28 18:26:02.752704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.752704    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13744h17m31.642478142s"
May 28 18:26:02.760345 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.760325    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f46gd"
May 28 18:26:02.767455 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.767437    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f46gd"
May 28 18:26:02.840327 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:02.840281    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1aebaf26e9365f9d0caa1f85512259.slice/crio-47c37f2a70238f804b2235aaf9490115159e33782f7ab4c0f3f142ba582fae54 WatchSource:0}: Error finding container 47c37f2a70238f804b2235aaf9490115159e33782f7ab4c0f3f142ba582fae54: Status 404 returned error can't find the container with id 47c37f2a70238f804b2235aaf9490115159e33782f7ab4c0f3f142ba582fae54
May 28 18:26:02.840536 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:02.840522    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod686ae0ccb4c85238b2f28e4a7df4d900.slice/crio-0f48f967b59dd9420052b30a4699ca230f2ef2a3da994cadce46754ec3f090e4 WatchSource:0}: Error finding container 0f48f967b59dd9420052b30a4699ca230f2ef2a3da994cadce46754ec3f090e4: Status 404 returned error can't find the container with id 0f48f967b59dd9420052b30a4699ca230f2ef2a3da994cadce46754ec3f090e4
May 28 18:26:02.842670 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.842650    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:02.845872 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.845858    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:26:02.872606 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.872558    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" event={"ID":"db1aebaf26e9365f9d0caa1f85512259","Type":"ContainerStarted","Data":"47c37f2a70238f804b2235aaf9490115159e33782f7ab4c0f3f142ba582fae54"}
May 28 18:26:02.873424 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:02.873402    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"686ae0ccb4c85238b2f28e4a7df4d900","Type":"ContainerStarted","Data":"0f48f967b59dd9420052b30a4699ca230f2ef2a3da994cadce46754ec3f090e4"}
May 28 18:26:02.942933 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:02.942908    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:03.043582 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.043503    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:03.144162 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.144126    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:03.245177 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.245135    2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-139-21.ec2.internal\" not found"
May 28 18:26:03.283056 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.283028    2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:03.328927 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.328852    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal"
May 28 18:26:03.341428 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.341404    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:26:03.345134 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.345100    2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal"
May 28 18:26:03.351305 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.351285    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:26:03.709850 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.709821    2574 apiserver.go:52] "Watching apiserver"
May 28 18:26:03.716484 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.716462    2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 18:26:03.716962 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.716931    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-9zf5t","openshift-network-diagnostics/network-check-target-hg8s2","openshift-network-operator/iptables-alerter-fmdpf","kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm","openshift-cluster-node-tuning-operator/tuned-8djjz","openshift-dns/node-resolver-llntx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal","openshift-multus/multus-additional-cni-plugins-tt4df","openshift-ovn-kubernetes/ovnkube-node-mkwsh","kube-system/global-pull-secret-syncer-f647h","kube-system/konnectivity-agent-6w6jd","openshift-image-registry/node-ca-v4ml8","openshift-multus/multus-gfzsd"]
May 28 18:26:03.719168 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.719147    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.720695 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.720671    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.721467 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.721450    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 18:26:03.721598 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.721574    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 18:26:03.721690 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.721598    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cd76t\""
May 28 18:26:03.721753 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.721721    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 18:26:03.722688 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.722658    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.723084 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.723068    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 18:26:03.723506 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.723469    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 18:26:03.723558 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.723502    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 18:26:03.723951 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.723929    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8xzlp\""
May 28 18:26:03.724060 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.724042    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 18:26:03.724583 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.724565    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.725443 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.725384    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 18:26:03.725876 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.725846    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 18:26:03.726153 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.726112    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 18:26:03.726153 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.726141    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4xqgx\""
May 28 18:26:03.727065 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.727033    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.727818 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.727588    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 18:26:03.727818 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.727726    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 18:26:03.727956 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.727944    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 18:26:03.728182 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.728033    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 18:26:03.728182 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.728065    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 18:26:03.728182 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.728081    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 18:26:03.728348 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.728195    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xhnrz\""
May 28 18:26:03.729325 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.729308    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.729765 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.729742    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 18:26:03.729765 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.729742    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 18:26:03.729952 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.729746    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vznln\""
May 28 18:26:03.731326 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.731311    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.731435 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.731425    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 18:26:03.731500 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.731465    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fkdms\""
May 28 18:26:03.731554 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.731530    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 18:26:03.733387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.733369    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 18:26:03.733657 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.733632    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gmmrp\""
May 28 18:26:03.733765 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.733751    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 18:26:03.735707 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.735464    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.735707 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.735534    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:03.735707 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.735561    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.735707 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.735637    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:03.738376 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.738358    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.740423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.740404    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.740813 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.740771    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xtpg4\""
May 28 18:26:03.740972 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.740955    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 18:26:03.741041 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.740971    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 18:26:03.742331 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.742314    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 18:26:03.742915 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.742630    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:03.742915 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.742688    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:03.742915 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.742716    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 18:26:03.742915 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.742730    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 18:26:03.743155 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743083    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mvgfh\""
May 28 18:26:03.743620 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtft\" (UniqueName: \"kubernetes.io/projected/201c926e-8601-40f9-8d23-49b22c60d373-kube-api-access-hbtft\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743702 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743624    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743702 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-sys\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.743835 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743696    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-cnibin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.743835 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743764    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-systemd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743835 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743820    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-log-socket\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-257pd\" (UniqueName: \"kubernetes.io/projected/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-kube-api-access-257pd\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743859    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-etc-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743895    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhk5c\" (UniqueName: \"kubernetes.io/projected/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kube-api-access-zhk5c\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743919    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743938    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-host\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743959    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.743996 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.743984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-daemon-config\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744036    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4tdl\" (UniqueName: \"kubernetes.io/projected/ed201536-7fa5-4a2a-8c40-638237654c5c-kube-api-access-v4tdl\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-hostroot\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed201536-7fa5-4a2a-8c40-638237654c5c-serviceca\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-systemd-units\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/201c926e-8601-40f9-8d23-49b22c60d373-ovn-node-metrics-cert\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744167    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-os-release\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744193    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed201536-7fa5-4a2a-8c40-638237654c5c-host\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744241    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239af890-ff27-498d-b394-5c3c8a59b8ac-hosts-file\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-etc-kubernetes\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744350    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-bin\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.744379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744373    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-tmp\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744395    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-var-lib-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744422    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-node-log\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744446    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-script-lib\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744539    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-system-cni-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744565    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-system-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744589    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-env-overrides\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744643    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-kubernetes\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744685    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-conf\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744711    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-os-release\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744758    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-bin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744803    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-conf-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744830    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-device-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744853    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-systemd\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744884    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7zhk\" (UniqueName: \"kubernetes.io/projected/58d90b2b-340b-481c-a65b-92c3fb0352da-kube-api-access-b7zhk\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744907    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jscjm\" (UniqueName: \"kubernetes.io/projected/239af890-ff27-498d-b394-5c3c8a59b8ac-kube-api-access-jscjm\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744933    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cnibin\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.744979    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-cni-binary-copy\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745018    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-netns\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745044    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7r9\" (UniqueName: \"kubernetes.io/projected/ab263e52-6b54-41d3-b185-e2a19a83a578-kube-api-access-dz7r9\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-netns\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-ovn\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745123    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-netd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745173    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745197    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysconfig\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-k8s-cni-cncf-io\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745242    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-kubelet\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745263    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-kubelet\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745302    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745336    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-modprobe-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.745879 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745365    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-run\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745390    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-socket-dir-parent\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-multus\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-config\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-tuned\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745498    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745527    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-slash\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745615    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745646    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745669    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-var-lib-kubelet\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239af890-ff27-498d-b394-5c3c8a59b8ac-tmp-dir\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745718    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-lib-modules\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.746426 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.745741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-multus-certs\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.768444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.768409    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:02 +0000 UTC" deadline="2027-12-06 23:16:02.856804217 +0000 UTC"
May 28 18:26:03.768539 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.768446    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13372h49m59.088361544s"
May 28 18:26:03.831827 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.831777    2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 18:26:03.846098 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846068    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-os-release\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.846098 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846100    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846121    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/768c076d-17da-41b8-bb55-d5d5f6dbf22c-agent-certs\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846154    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/768c076d-17da-41b8-bb55-d5d5f6dbf22c-konnectivity-ca\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846187    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-os-release\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846215    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed201536-7fa5-4a2a-8c40-638237654c5c-host\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846243    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846270    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239af890-ff27-498d-b394-5c3c8a59b8ac-hosts-file\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846275    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ed201536-7fa5-4a2a-8c40-638237654c5c-host\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846299    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-etc-kubernetes\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.846330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846329    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/239af890-ff27-498d-b394-5c3c8a59b8ac-hosts-file\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846328    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f6058c8-8d47-4639-b562-279b427aa2bd-host-slash\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846367    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-etc-kubernetes\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846381    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-bin\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-socket-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846403    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-tmp\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846446    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-var-lib-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846453    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-bin\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846474    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-node-log\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846494    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-var-lib-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846502    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-script-lib\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846544    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-node-log\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846576    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-system-cni-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846602    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-system-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-system-cni-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846625    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846680    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.846842 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846685    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-system-cni-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846695    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgj65\" (UniqueName: \"kubernetes.io/projected/4f6058c8-8d47-4639-b562-279b427aa2bd-kube-api-access-tgj65\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846699    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846726    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-binary-copy\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846721    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-env-overrides\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846808    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-kubernetes\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846832    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-conf\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846858    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-os-release\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846880    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-bin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846904    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-conf-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846928    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-device-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846939    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-kubernetes\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846953    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-systemd\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846976    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7zhk\" (UniqueName: \"kubernetes.io/projected/58d90b2b-340b-481c-a65b-92c3fb0352da-kube-api-access-b7zhk\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.846989    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-bin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847002    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-conf-dir\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847005    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jscjm\" (UniqueName: \"kubernetes.io/projected/239af890-ff27-498d-b394-5c3c8a59b8ac-kube-api-access-jscjm\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847015    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-conf\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.847601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847040    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-script-lib\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847062    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cnibin\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847066    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-device-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847070    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-os-release\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847086    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-cni-binary-copy\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847095    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-systemd\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847094    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-env-overrides\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847109    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-netns\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847125    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cnibin\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847133    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7r9\" (UniqueName: \"kubernetes.io/projected/ab263e52-6b54-41d3-b185-e2a19a83a578-kube-api-access-dz7r9\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847155    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-netns\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847171    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-netns\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847175    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-ovn\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847208    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-netd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847213    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-ovn\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847238    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847249    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-netns\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847256    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-cni-netd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.848281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847282    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847308    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysconfig\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847326    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-sys-fs\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847356    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-etc-selinux\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847363    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysconfig\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847336    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-k8s-cni-cncf-io\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847411    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-k8s-cni-cncf-io\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847415    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-kubelet\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847433    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-kubelet\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847452    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-kubelet\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847479    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847504    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-modprobe-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847528    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-run\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847533    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-kubelet\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847552    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-socket-dir-parent\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847571    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-registration-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847579    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-multus\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847596    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-cni-binary-copy\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849078 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847620    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-run\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847624    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-var-lib-cni-multus\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847629    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-socket-dir-parent\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847643    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-modprobe-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847644    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-dbus\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847674    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847699    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-config\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847821    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-tuned\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847845    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847872    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f6058c8-8d47-4639-b562-279b427aa2bd-iptables-alerter-script\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkfjq\" (UniqueName: \"kubernetes.io/projected/8009cfe7-6d52-480c-9e82-d2379b9df5a5-kube-api-access-nkfjq\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847922    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-slash\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847944    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847968    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847980    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847986    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-slash\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.847995    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-var-lib-kubelet\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.849710 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848020    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239af890-ff27-498d-b394-5c3c8a59b8ac-tmp-dir\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848037    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848044    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-lib-modules\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848018    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-run-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848046    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-var-lib-kubelet\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848071    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-multus-certs\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848097    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtft\" (UniqueName: \"kubernetes.io/projected/201c926e-8601-40f9-8d23-49b22c60d373-kube-api-access-hbtft\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848100    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/201c926e-8601-40f9-8d23-49b22c60d373-ovnkube-config\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848124    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848150    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-sys\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848157    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-host-run-multus-certs\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-lib-modules\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848175    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-cnibin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848208    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848233    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-cnibin\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848227    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848261    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-sys\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.850391 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848277    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-systemd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848303    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-log-socket\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848328    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-257pd\" (UniqueName: \"kubernetes.io/projected/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-kube-api-access-257pd\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848345    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-systemd\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848355    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848328    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239af890-ff27-498d-b394-5c3c8a59b8ac-tmp-dir\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-log-socket\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848421    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-run-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848433    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-etc-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848474    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhk5c\" (UniqueName: \"kubernetes.io/projected/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kube-api-access-zhk5c\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848479    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-etc-openvswitch\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848501    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848526    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-host\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848557    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848582    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-daemon-config\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848605    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-host\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848614    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-kubelet-config\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.851038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848642    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-sysctl-d\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848669    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4tdl\" (UniqueName: \"kubernetes.io/projected/ed201536-7fa5-4a2a-8c40-638237654c5c-kube-api-access-v4tdl\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848699    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-hostroot\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848743    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab263e52-6b54-41d3-b185-e2a19a83a578-hostroot\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848834    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed201536-7fa5-4a2a-8c40-638237654c5c-serviceca\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848874    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-systemd-units\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848916    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/201c926e-8601-40f9-8d23-49b22c60d373-systemd-units\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.848960    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/201c926e-8601-40f9-8d23-49b22c60d373-ovn-node-metrics-cert\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.849188    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab263e52-6b54-41d3-b185-e2a19a83a578-multus-daemon-config\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.849196    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.849190    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.849288    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ed201536-7fa5-4a2a-8c40-638237654c5c-serviceca\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.850013    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-tmp\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.850048    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/58d90b2b-340b-481c-a65b-92c3fb0352da-etc-tuned\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.851496 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.850946    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/201c926e-8601-40f9-8d23-49b22c60d373-ovn-node-metrics-cert\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.861423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.861396    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jscjm\" (UniqueName: \"kubernetes.io/projected/239af890-ff27-498d-b394-5c3c8a59b8ac-kube-api-access-jscjm\") pod \"node-resolver-llntx\" (UID: \"239af890-ff27-498d-b394-5c3c8a59b8ac\") " pod="openshift-dns/node-resolver-llntx"
May 28 18:26:03.861855 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.861836    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7zhk\" (UniqueName: \"kubernetes.io/projected/58d90b2b-340b-481c-a65b-92c3fb0352da-kube-api-access-b7zhk\") pod \"tuned-8djjz\" (UID: \"58d90b2b-340b-481c-a65b-92c3fb0352da\") " pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:03.862676 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.862655    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7r9\" (UniqueName: \"kubernetes.io/projected/ab263e52-6b54-41d3-b185-e2a19a83a578-kube-api-access-dz7r9\") pod \"multus-gfzsd\" (UID: \"ab263e52-6b54-41d3-b185-e2a19a83a578\") " pod="openshift-multus/multus-gfzsd"
May 28 18:26:03.864500 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.864482    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4tdl\" (UniqueName: \"kubernetes.io/projected/ed201536-7fa5-4a2a-8c40-638237654c5c-kube-api-access-v4tdl\") pod \"node-ca-v4ml8\" (UID: \"ed201536-7fa5-4a2a-8c40-638237654c5c\") " pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:03.864761 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.864739    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtft\" (UniqueName: \"kubernetes.io/projected/201c926e-8601-40f9-8d23-49b22c60d373-kube-api-access-hbtft\") pod \"ovnkube-node-mkwsh\" (UID: \"201c926e-8601-40f9-8d23-49b22c60d373\") " pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:03.865604 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.865585    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhk5c\" (UniqueName: \"kubernetes.io/projected/8803e3ea-69a6-4b54-8ba4-18462fe16ad0-kube-api-access-zhk5c\") pod \"aws-ebs-csi-driver-node-trmpm\" (UID: \"8803e3ea-69a6-4b54-8ba4-18462fe16ad0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:03.865984 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.865968    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-257pd\" (UniqueName: \"kubernetes.io/projected/c6a2eb7e-ba5d-48a6-a223-fe80f229d218-kube-api-access-257pd\") pod \"multus-additional-cni-plugins-tt4df\" (UID: \"c6a2eb7e-ba5d-48a6-a223-fe80f229d218\") " pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:03.950285 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950249    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-kubelet-config\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950295    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950321    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/768c076d-17da-41b8-bb55-d5d5f6dbf22c-agent-certs\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950347    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/768c076d-17da-41b8-bb55-d5d5f6dbf22c-konnectivity-ca\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950351    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-kubelet-config\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950375    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f6058c8-8d47-4639-b562-279b427aa2bd-host-slash\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.950466 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950422    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f6058c8-8d47-4639-b562-279b427aa2bd-host-slash\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.950476    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950474    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj65\" (UniqueName: \"kubernetes.io/projected/4f6058c8-8d47-4639-b562-279b427aa2bd-kube-api-access-tgj65\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.950558    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.450534427 +0000 UTC m=+3.151011421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950578    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-dbus\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950606    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950633    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f6058c8-8d47-4639-b562-279b427aa2bd-iptables-alerter-script\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950658    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkfjq\" (UniqueName: \"kubernetes.io/projected/8009cfe7-6d52-480c-9e82-d2379b9df5a5-kube-api-access-nkfjq\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.950735 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950693    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:03.951145 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950827    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6c599fce-b3fe-4ac8-8abd-b2550678327d-dbus\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:03.951145 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.950947    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/768c076d-17da-41b8-bb55-d5d5f6dbf22c-konnectivity-ca\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.951145 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.951091    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:03.951289 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.951160    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.451142952 +0000 UTC m=+3.151619924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:03.951289 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.951265    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f6058c8-8d47-4639-b562-279b427aa2bd-iptables-alerter-script\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:03.952972 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.952945    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/768c076d-17da-41b8-bb55-d5d5f6dbf22c-agent-certs\") pod \"konnectivity-agent-6w6jd\" (UID: \"768c076d-17da-41b8-bb55-d5d5f6dbf22c\") " pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:03.956886 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.956864    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:03.956886 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.956887    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:03.957025 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.956899    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:03.957025 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:03.956956    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.456939421 +0000 UTC m=+3.157416396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:03.959308 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.959279    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkfjq\" (UniqueName: \"kubernetes.io/projected/8009cfe7-6d52-480c-9e82-d2379b9df5a5-kube-api-access-nkfjq\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:03.959971 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:03.959924    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgj65\" (UniqueName: \"kubernetes.io/projected/4f6058c8-8d47-4639-b562-279b427aa2bd-kube-api-access-tgj65\") pod \"iptables-alerter-fmdpf\" (UID: \"4f6058c8-8d47-4639-b562-279b427aa2bd\") " pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:04.030332 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.030306    2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:26:04.034265 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.034240    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v4ml8"
May 28 18:26:04.040998 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.040976    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gfzsd"
May 28 18:26:04.049678 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.049656    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:04.054465 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.054442    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm"
May 28 18:26:04.060903 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.060880    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8djjz"
May 28 18:26:04.066383 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.066358    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-llntx"
May 28 18:26:04.075988 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.075967    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tt4df"
May 28 18:26:04.082583 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.082562    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:04.088156 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.088139    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmdpf"
May 28 18:26:04.400756 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.400710    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8803e3ea_69a6_4b54_8ba4_18462fe16ad0.slice/crio-483aaa00b14b99290d073def082edb980bb611916cfd17199875b5a48f3a88aa WatchSource:0}: Error finding container 483aaa00b14b99290d073def082edb980bb611916cfd17199875b5a48f3a88aa: Status 404 returned error can't find the container with id 483aaa00b14b99290d073def082edb980bb611916cfd17199875b5a48f3a88aa
May 28 18:26:04.401634 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.401604    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6058c8_8d47_4639_b562_279b427aa2bd.slice/crio-cdaac840db761ff574dfc04ce2917ed7643638d885fb01802b5f48e03fe9851b WatchSource:0}: Error finding container cdaac840db761ff574dfc04ce2917ed7643638d885fb01802b5f48e03fe9851b: Status 404 returned error can't find the container with id cdaac840db761ff574dfc04ce2917ed7643638d885fb01802b5f48e03fe9851b
May 28 18:26:04.402378 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.402352    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded201536_7fa5_4a2a_8c40_638237654c5c.slice/crio-9149e248aa35ba39b976de863204dedca10a8e0aee42de9d269b8586f5eb610c WatchSource:0}: Error finding container 9149e248aa35ba39b976de863204dedca10a8e0aee42de9d269b8586f5eb610c: Status 404 returned error can't find the container with id 9149e248aa35ba39b976de863204dedca10a8e0aee42de9d269b8586f5eb610c
May 28 18:26:04.404070 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.404001    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab263e52_6b54_41d3_b185_e2a19a83a578.slice/crio-403800f3a602e88a9800a641994e36781a6dd3b4efb610491851ead187865cdb WatchSource:0}: Error finding container 403800f3a602e88a9800a641994e36781a6dd3b4efb610491851ead187865cdb: Status 404 returned error can't find the container with id 403800f3a602e88a9800a641994e36781a6dd3b4efb610491851ead187865cdb
May 28 18:26:04.406320 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.406262    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201c926e_8601_40f9_8d23_49b22c60d373.slice/crio-586e31fe1ba6c2eccf86ab65cf89e47361e66f6e0c8f69418f4b1b3000013e02 WatchSource:0}: Error finding container 586e31fe1ba6c2eccf86ab65cf89e47361e66f6e0c8f69418f4b1b3000013e02: Status 404 returned error can't find the container with id 586e31fe1ba6c2eccf86ab65cf89e47361e66f6e0c8f69418f4b1b3000013e02
May 28 18:26:04.408077 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.408053    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod768c076d_17da_41b8_bb55_d5d5f6dbf22c.slice/crio-af0cdc6c3f8c672ba6c0c8554be7cbcce41a150268d8ce17645b0dc28d7d829b WatchSource:0}: Error finding container af0cdc6c3f8c672ba6c0c8554be7cbcce41a150268d8ce17645b0dc28d7d829b: Status 404 returned error can't find the container with id af0cdc6c3f8c672ba6c0c8554be7cbcce41a150268d8ce17645b0dc28d7d829b
May 28 18:26:04.408772 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.408634    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a2eb7e_ba5d_48a6_a223_fe80f229d218.slice/crio-64bd0c419237f9d4367985aba9eaf604500a3c73f3fe7561eb1f571e1a71d799 WatchSource:0}: Error finding container 64bd0c419237f9d4367985aba9eaf604500a3c73f3fe7561eb1f571e1a71d799: Status 404 returned error can't find the container with id 64bd0c419237f9d4367985aba9eaf604500a3c73f3fe7561eb1f571e1a71d799
May 28 18:26:04.409432 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.409392    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58d90b2b_340b_481c_a65b_92c3fb0352da.slice/crio-5dd1104a2419c7723ba2f2f795d1a3c80e3511fee2c0cb021525dd263ab16da3 WatchSource:0}: Error finding container 5dd1104a2419c7723ba2f2f795d1a3c80e3511fee2c0cb021525dd263ab16da3: Status 404 returned error can't find the container with id 5dd1104a2419c7723ba2f2f795d1a3c80e3511fee2c0cb021525dd263ab16da3
May 28 18:26:04.410459 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:04.410422    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239af890_ff27_498d_b394_5c3c8a59b8ac.slice/crio-a9b29f245c530ef2ecec98ff4f080c1295ee8588cd361d6ff5b035f930c2586a WatchSource:0}: Error finding container a9b29f245c530ef2ecec98ff4f080c1295ee8588cd361d6ff5b035f930c2586a: Status 404 returned error can't find the container with id a9b29f245c530ef2ecec98ff4f080c1295ee8588cd361d6ff5b035f930c2586a
May 28 18:26:04.454642 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.454505    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:04.454642 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.454635    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:04.454802 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.454689    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:05.454674669 +0000 UTC m=+4.155151639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:04.454802 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.454708    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:04.454802 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.454768    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:04.454919 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.454810    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:05.454802695 +0000 UTC m=+4.155279665 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:04.555330 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.555298    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:04.555532 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.555511    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:04.555604 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.555537    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:04.555604 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.555553    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:04.555697 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.555618    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:05.555594782 +0000 UTC m=+4.256071757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:04.769276 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.769232    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:21:02 +0000 UTC" deadline="2028-01-27 18:32:31.585268472 +0000 UTC"
May 28 18:26:04.769276 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.769276    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14616h6m26.815996637s"
May 28 18:26:04.870012 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.869978    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:04.870179 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.870108    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:04.870251 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.870202    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:04.870366 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.870347    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:04.870442 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.870430    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:04.870525 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:04.870509    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:04.892017 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.891981    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" event={"ID":"db1aebaf26e9365f9d0caa1f85512259","Type":"ContainerStarted","Data":"9eb6d6f69706fa90e3baa105843a9294a19e25d5ce43b441ee0ef999000aa265"}
May 28 18:26:04.899019 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.898989    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-llntx" event={"ID":"239af890-ff27-498d-b394-5c3c8a59b8ac","Type":"ContainerStarted","Data":"a9b29f245c530ef2ecec98ff4f080c1295ee8588cd361d6ff5b035f930c2586a"}
May 28 18:26:04.902749 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.902717    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8djjz" event={"ID":"58d90b2b-340b-481c-a65b-92c3fb0352da","Type":"ContainerStarted","Data":"5dd1104a2419c7723ba2f2f795d1a3c80e3511fee2c0cb021525dd263ab16da3"}
May 28 18:26:04.907165 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.907133    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6w6jd" event={"ID":"768c076d-17da-41b8-bb55-d5d5f6dbf22c","Type":"ContainerStarted","Data":"af0cdc6c3f8c672ba6c0c8554be7cbcce41a150268d8ce17645b0dc28d7d829b"}
May 28 18:26:04.917013 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.916988    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmdpf" event={"ID":"4f6058c8-8d47-4639-b562-279b427aa2bd","Type":"ContainerStarted","Data":"cdaac840db761ff574dfc04ce2917ed7643638d885fb01802b5f48e03fe9851b"}
May 28 18:26:04.924676 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.924652    2574 generic.go:358] "Generic (PLEG): container finished" podID="686ae0ccb4c85238b2f28e4a7df4d900" containerID="2cbd200942eba50be72a70bd7d10f52d7d9f2c10a1f097edd6a6755651ec8466" exitCode=0
May 28 18:26:04.924784 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.924718    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"686ae0ccb4c85238b2f28e4a7df4d900","Type":"ContainerDied","Data":"2cbd200942eba50be72a70bd7d10f52d7d9f2c10a1f097edd6a6755651ec8466"}
May 28 18:26:04.936822 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.936784    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerStarted","Data":"64bd0c419237f9d4367985aba9eaf604500a3c73f3fe7561eb1f571e1a71d799"}
May 28 18:26:04.940640 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.940593    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-21.ec2.internal" podStartSLOduration=1.940577952 podStartE2EDuration="1.940577952s" podCreationTimestamp="2026-05-28 18:26:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:04.906754113 +0000 UTC m=+3.607231106" watchObservedRunningTime="2026-05-28 18:26:04.940577952 +0000 UTC m=+3.641054945"
May 28 18:26:04.951691 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.951657    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"586e31fe1ba6c2eccf86ab65cf89e47361e66f6e0c8f69418f4b1b3000013e02"}
May 28 18:26:04.960444 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.960415    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gfzsd" event={"ID":"ab263e52-6b54-41d3-b185-e2a19a83a578","Type":"ContainerStarted","Data":"403800f3a602e88a9800a641994e36781a6dd3b4efb610491851ead187865cdb"}
May 28 18:26:04.966863 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.966840    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4ml8" event={"ID":"ed201536-7fa5-4a2a-8c40-638237654c5c","Type":"ContainerStarted","Data":"9149e248aa35ba39b976de863204dedca10a8e0aee42de9d269b8586f5eb610c"}
May 28 18:26:04.972623 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:04.972597    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm" event={"ID":"8803e3ea-69a6-4b54-8ba4-18462fe16ad0","Type":"ContainerStarted","Data":"483aaa00b14b99290d073def082edb980bb611916cfd17199875b5a48f3a88aa"}
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:05.463358    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:05.463435    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.463590    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.463656    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:07.46363596 +0000 UTC m=+6.164112930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.464043    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:05.464119 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.464087    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:07.464073651 +0000 UTC m=+6.164550635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:05.564003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:05.563966    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:05.564186 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.564173    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:05.564251 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.564192    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:05.564251 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.564204    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:05.564346 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:05.564262    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:07.564243519 +0000 UTC m=+6.264720490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:05.995454 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:05.995418    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" event={"ID":"686ae0ccb4c85238b2f28e4a7df4d900","Type":"ContainerStarted","Data":"7133292ef55c22758e0338653b14215bfebf9dbb3ecd9c4999ad41043f0b3f47"}
May 28 18:26:06.869982 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:06.869946    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:06.870170 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:06.870079    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:06.870537 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:06.870516    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:06.870642 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:06.870620    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:06.870712 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:06.870690    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:06.870813 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:06.870777    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:07.480303 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:07.480253    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:07.480744 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:07.480332    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:07.480744 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.480390    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:07.480744 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.480439    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:07.480744 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.480469    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.480446995 +0000 UTC m=+10.180923989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:07.480744 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.480493    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.480483271 +0000 UTC m=+10.180960242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:07.581170 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:07.581047    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:07.581342 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.581242    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:07.581342 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.581265    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:07.581342 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.581278    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:07.581342 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:07.581337    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:11.581318613 +0000 UTC m=+10.281795595 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:08.870096 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:08.870001    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:08.870096 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:08.870023    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:08.870096 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:08.870023    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:08.870663 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:08.870129    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:08.870663 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:08.870271    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:08.870663 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:08.870355    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:10.870068 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:10.869931    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:10.870068 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:10.869964    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:10.870643 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:10.870075    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:10.870643 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:10.870148    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:10.870643 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:10.870244    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:10.870643 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:10.870320    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:11.515811 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:11.515721    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:11.516005 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:11.515833    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:11.516005 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.515962    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.516005 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.515966    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:11.516167 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.516024    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:19.516006345 +0000 UTC m=+18.216483317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:11.516167 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.516049    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:19.51603134 +0000 UTC m=+18.216508335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:11.616820 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:11.616768    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:11.617000 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.616924    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:11.617000 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.616949    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:11.617000 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.616962    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:11.617152 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:11.617026    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:19.617008538 +0000 UTC m=+18.317485509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:12.869300 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:12.869219    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:12.869807 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:12.869310    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:12.869807 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:12.869417    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:12.869807 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:12.869532    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:12.869807 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:12.869571    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:12.869807 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:12.869631    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:14.870149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:14.870117    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:14.870541 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:14.870116    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:14.870541 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:14.870227    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:14.870541 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:14.870335    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:14.870541 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:14.870114    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:14.870945 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:14.870922    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:16.869254 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:16.869218    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:16.869773 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:16.869263    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:16.869773 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:16.869218    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:16.869773 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:16.869333    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:16.869773 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:16.869388    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:16.869773 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:16.869473    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:18.869769 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:18.869730    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:18.870250 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:18.869778    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:18.870250 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:18.869877    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:18.870250 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:18.869972    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:18.870250 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:18.870030    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:18.870250 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:18.870113    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:19.577042 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:19.577005    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:19.577193 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:19.577074    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:19.577193 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.577151    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:19.577193 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.577176    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:19.577338 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.577215    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:26:35.57719847 +0000 UTC m=+34.277675453 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:19.577338 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.577230    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:35.577223013 +0000 UTC m=+34.277699983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:19.677771 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:19.677730    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:19.677956 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.677887    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:19.677956 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.677911    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:19.677956 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.677923    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:19.678107 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:19.677990    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:35.677971391 +0000 UTC m=+34.378448379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:20.869761 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:20.869723    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:20.870164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:20.869771    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:20.870164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:20.869742    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:20.870164 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:20.869863    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:20.870164 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:20.869989    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:20.870164 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:20.870056    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:22.869998 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:22.869677    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:22.870951 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:22.869675    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:22.870951 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:22.870068    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:22.870951 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:22.870137    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:22.870951 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:22.869675    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:22.870951 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:22.870204    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:23.024417 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.024383    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v4ml8" event={"ID":"ed201536-7fa5-4a2a-8c40-638237654c5c","Type":"ContainerStarted","Data":"e6be71eed34c5368d4d18a71926e51f09e686ce0699fa238746d29e2814aedb1"}
May 28 18:26:23.025421 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.025395    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm" event={"ID":"8803e3ea-69a6-4b54-8ba4-18462fe16ad0","Type":"ContainerStarted","Data":"46b42794dcfaccc525a205b237f329823762c4c82edc6ca3a537aeeccc660b06"}
May 28 18:26:23.026424 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.026405    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-llntx" event={"ID":"239af890-ff27-498d-b394-5c3c8a59b8ac","Type":"ContainerStarted","Data":"cf62b5f1af93c35cb51ea512a5462a78e35ad808c4d0b8d5ea80560fbdc0bd97"}
May 28 18:26:23.027365 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.027347    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8djjz" event={"ID":"58d90b2b-340b-481c-a65b-92c3fb0352da","Type":"ContainerStarted","Data":"d35e3eb2ad6923b86c9441f1c7339f7adc900265c2681989c708db2bd0545fd0"}
May 28 18:26:23.030128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.030109    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6w6jd" event={"ID":"768c076d-17da-41b8-bb55-d5d5f6dbf22c","Type":"ContainerStarted","Data":"65a619cd1e5020925576d535958191b12b1be4f96bb70a3a7175e2b706620183"}
May 28 18:26:23.031235 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.031216    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="a3da76da6d0a2e9d826931912d227711187ea44507821d9a00e4378af763997d" exitCode=0
May 28 18:26:23.031322 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.031286    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"a3da76da6d0a2e9d826931912d227711187ea44507821d9a00e4378af763997d"}
May 28 18:26:23.033038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.033019    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"21af5d101ac5a229704cdc0760f528f84d0d0084d9808ba0252554d40af7ab6a"}
May 28 18:26:23.033126 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.033044    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"a0b08c9d96c9d85ae51d21593d2723ad03e3be53c12337d5345aa25ce9b88a0a"}
May 28 18:26:23.033126 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.033057    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"d3ee8f7dc518251bdaa837c5ef2f61cde891cdb5a7dacfa395371d9cd0ac069c"}
May 28 18:26:23.034156 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.034139    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gfzsd" event={"ID":"ab263e52-6b54-41d3-b185-e2a19a83a578","Type":"ContainerStarted","Data":"17fe9b3bdb5661b9b160702365eaa3857116f24109569565799e528a71f75e2e"}
May 28 18:26:23.054128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.054093    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-21.ec2.internal" podStartSLOduration=20.054082756 podStartE2EDuration="20.054082756s" podCreationTimestamp="2026-05-28 18:26:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:26:06.010714661 +0000 UTC m=+4.711191653" watchObservedRunningTime="2026-05-28 18:26:23.054082756 +0000 UTC m=+21.754559773"
May 28 18:26:23.068253 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.068219    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-llntx" podStartSLOduration=2.9773476199999998 podStartE2EDuration="21.068204741s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.412247643 +0000 UTC m=+3.112724615" lastFinishedPulling="2026-05-28 18:26:22.503104763 +0000 UTC m=+21.203581736" observedRunningTime="2026-05-28 18:26:23.067888876 +0000 UTC m=+21.768365868" watchObservedRunningTime="2026-05-28 18:26:23.068204741 +0000 UTC m=+21.768681735"
May 28 18:26:23.084384 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.084339    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v4ml8" podStartSLOduration=12.051424779 podStartE2EDuration="22.084326888s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.404289504 +0000 UTC m=+3.104766476" lastFinishedPulling="2026-05-28 18:26:14.437191616 +0000 UTC m=+13.137668585" observedRunningTime="2026-05-28 18:26:23.083721739 +0000 UTC m=+21.784198732" watchObservedRunningTime="2026-05-28 18:26:23.084326888 +0000 UTC m=+21.784803879"
May 28 18:26:23.099430 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.099344    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8djjz" podStartSLOduration=2.983326238 podStartE2EDuration="21.099314612s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.411474797 +0000 UTC m=+3.111951767" lastFinishedPulling="2026-05-28 18:26:22.527463169 +0000 UTC m=+21.227940141" observedRunningTime="2026-05-28 18:26:23.098906745 +0000 UTC m=+21.799383737" watchObservedRunningTime="2026-05-28 18:26:23.099314612 +0000 UTC m=+21.799791606"
May 28 18:26:23.114345 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.114294    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6w6jd" podStartSLOduration=3.021870816 podStartE2EDuration="21.114277812s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.410698595 +0000 UTC m=+3.111175569" lastFinishedPulling="2026-05-28 18:26:22.503105581 +0000 UTC m=+21.203582565" observedRunningTime="2026-05-28 18:26:23.113757078 +0000 UTC m=+21.814234069" watchObservedRunningTime="2026-05-28 18:26:23.114277812 +0000 UTC m=+21.814754805"
May 28 18:26:23.136020 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.135480    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-gfzsd" podStartSLOduration=3.924264098 podStartE2EDuration="22.135464714s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.405984251 +0000 UTC m=+3.106461220" lastFinishedPulling="2026-05-28 18:26:22.617184867 +0000 UTC m=+21.317661836" observedRunningTime="2026-05-28 18:26:23.135154202 +0000 UTC m=+21.835631195" watchObservedRunningTime="2026-05-28 18:26:23.135464714 +0000 UTC m=+21.835941707"
May 28 18:26:23.839026 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:23.838997    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 18:26:24.038011 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.037908    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmdpf" event={"ID":"4f6058c8-8d47-4639-b562-279b427aa2bd","Type":"ContainerStarted","Data":"7461c91a6d327742ef4f9a1990ad3c3f949ee115aa94afa6b359cfb7d422c878"}
May 28 18:26:24.041128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.041092    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"a895db616f208cbd8d2eaa003d89a0a21d2b49eaf54fb2dcb6cd60c315955f2f"}
May 28 18:26:24.041128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.041126    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"cad2749715c154718367504ee8ee4e4071f0ef4ba8b563e40ca77985cf0e81a7"}
May 28 18:26:24.041319 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.041136    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"8cc466f478c07dee216253de58d5a32a6a5a1d3866fb6090799347de16ef5865"}
May 28 18:26:24.042830 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.042764    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm" event={"ID":"8803e3ea-69a6-4b54-8ba4-18462fe16ad0","Type":"ContainerStarted","Data":"78a465d17c206017d5aea48576b7ef7a97af827570593985719ae0a3c8d244d9"}
May 28 18:26:24.053147 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.053108    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmdpf" podStartSLOduration=3.953327624 podStartE2EDuration="22.053096477s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.403343992 +0000 UTC m=+3.103820963" lastFinishedPulling="2026-05-28 18:26:22.503112832 +0000 UTC m=+21.203589816" observedRunningTime="2026-05-28 18:26:24.052589415 +0000 UTC m=+22.753066407" watchObservedRunningTime="2026-05-28 18:26:24.053096477 +0000 UTC m=+22.753573469"
May 28 18:26:24.813056 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.812919    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:26:23.839021435Z","UUID":"4f4b4983-cace-4c00-b195-b0baffdf7b45","Handler":null,"Name":"","Endpoint":""}
May 28 18:26:24.815854 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.815827    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 18:26:24.815978 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.815863    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 18:26:24.870120 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.870090    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:24.870269 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.870090    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:24.870269 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:24.870212    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:24.870379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:24.870090    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:24.870379 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:24.870283    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:24.870379 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:24.870341    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:26.050166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.049931    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"c1021efb9749f8ca67fa4a29720183d29ae2613e8973abd2e5d97c3a911407f7"}
May 28 18:26:26.054630 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.054598    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm" event={"ID":"8803e3ea-69a6-4b54-8ba4-18462fe16ad0","Type":"ContainerStarted","Data":"967daef5f9fd386dfc01f29326a0e39c881101279303ac6bddf3bc844dc29dae"}
May 28 18:26:26.071921 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.071874    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-trmpm" podStartSLOduration=3.5060383489999998 podStartE2EDuration="24.071861735s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.40220252 +0000 UTC m=+3.102679490" lastFinishedPulling="2026-05-28 18:26:24.968025893 +0000 UTC m=+23.668502876" observedRunningTime="2026-05-28 18:26:26.07168115 +0000 UTC m=+24.772158144" watchObservedRunningTime="2026-05-28 18:26:26.071861735 +0000 UTC m=+24.772338723"
May 28 18:26:26.870286 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.870251    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:26.870486 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.870251    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:26.870486 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:26.870362    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:26.870486 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:26.870422    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:26.870486 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:26.870251    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:26.870651 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:26.870500    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:27.422848 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:27.422807    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:27.423472 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:27.423452    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:28.061847 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.061536    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" event={"ID":"201c926e-8601-40f9-8d23-49b22c60d373","Type":"ContainerStarted","Data":"fa70475a3863a645195f4c99a1f0036b2ae257ac65f6a86fde86b68d0edbbd7e"}
May 28 18:26:28.061847 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.061763    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:28.063227 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.063202    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="4067d00476bccdb661cb71db35d10252502688b1b6f5c4ed1af11ef2c345ec74" exitCode=0
May 28 18:26:28.063360 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.063283    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"4067d00476bccdb661cb71db35d10252502688b1b6f5c4ed1af11ef2c345ec74"}
May 28 18:26:28.077699 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.077679    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:28.113845 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.112821    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh" podStartSLOduration=7.993157126 podStartE2EDuration="26.112804247s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.408249374 +0000 UTC m=+3.108726359" lastFinishedPulling="2026-05-28 18:26:22.52789651 +0000 UTC m=+21.228373480" observedRunningTime="2026-05-28 18:26:28.086970462 +0000 UTC m=+26.787447453" watchObservedRunningTime="2026-05-28 18:26:28.112804247 +0000 UTC m=+26.813281233"
May 28 18:26:28.869760 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.869723    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:28.869760 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.869754    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:28.870534 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:28.869737    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:28.870534 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:28.869877    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:28.870534 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:28.869963    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:28.870534 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:28.870037    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:29.067144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.067064    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="76b5d7551c64c374f84bf3cf4b1b18c63167d78fb00f2fdea5d373d81c456831" exitCode=0
May 28 18:26:29.067309 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.067147    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"76b5d7551c64c374f84bf3cf4b1b18c63167d78fb00f2fdea5d373d81c456831"}
May 28 18:26:29.068053 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.067839    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:29.068053 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.067881    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:29.083237 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.083216    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:26:29.609179 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.609145    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zf5t"]
May 28 18:26:29.609338 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.609251    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:29.609405 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:29.609349    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:29.611342 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.611276    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg8s2"]
May 28 18:26:29.611464 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.611368    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:29.611521 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:29.611462    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:29.611905 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.611879    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f647h"]
May 28 18:26:29.612001 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:29.611961    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:29.612091 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:29.612051    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:30.070745 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:30.070659    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="d14c22a72a4384ab3d7d5cdca8ed5362a407900e6828d8fc611f525f70b8af3a" exitCode=0
May 28 18:26:30.071120 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:30.070754    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"d14c22a72a4384ab3d7d5cdca8ed5362a407900e6828d8fc611f525f70b8af3a"}
May 28 18:26:30.870110 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:30.870078    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:30.870275 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:30.870194    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:31.033072 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:31.033041    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:31.033232 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:31.033179    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 28 18:26:31.033645 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:31.033616    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6w6jd"
May 28 18:26:31.870508 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:31.870479    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:31.870896 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:31.870560    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:31.870896 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:31.870650    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:31.870896 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:31.870749    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:32.870357 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:32.870181    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:32.870534 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:32.870466    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:33.869986 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:33.869948    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:33.870134 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:33.870074    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f647h" podUID="6c599fce-b3fe-4ac8-8abd-b2550678327d"
May 28 18:26:33.870134 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:33.870123    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:33.870253 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:33.870232    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hg8s2" podUID="6bd5ec75-0653-405a-8d5e-134cca3ffa23"
May 28 18:26:34.869683 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:34.869645    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:34.870231 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:34.869776    2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9zf5t" podUID="8009cfe7-6d52-480c-9e82-d2379b9df5a5"
May 28 18:26:35.157442 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.157370    2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-139-21.ec2.internal" event="NodeReady"
May 28 18:26:35.157661 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.157505    2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 18:26:35.198161 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.198115    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:26:35.222619 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.222576    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2grkj"]
May 28 18:26:35.222805 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.222730    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.225162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.225132    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 18:26:35.225162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.225150    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 18:26:35.225563 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.225546    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 18:26:35.225840 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.225823    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-brjsz\""
May 28 18:26:35.233282 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.233264    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 18:26:35.236288 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.236265    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:26:35.236393 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.236300    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2grkj"]
May 28 18:26:35.236456 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.236408    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.238741 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.238660    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 18:26:35.238864 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.238757    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsslr\""
May 28 18:26:35.238864 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.238761    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 18:26:35.239052 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.239033    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 18:26:35.328100 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.328066    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qx5nz"]
May 28 18:26:35.343130 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.343092    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx5nz"]
May 28 18:26:35.343294 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.343171    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.345622 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.345595    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2d7l\""
May 28 18:26:35.345749 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.345663    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 18:26:35.345838 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.345600    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 18:26:35.407333 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xslg\" (UniqueName: \"kubernetes.io/projected/5f99c87f-752c-44c4-8f70-d04ddc039dc2-kube-api-access-9xslg\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407394    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407416    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407456    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407547 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407819 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407550    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttnf4\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407819 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.407819 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.407598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508348 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508309    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttnf4\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508533 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508359    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508533 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508383    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508533 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508407    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3d51139-f5f4-4efc-be76-4f78b7d147b9-config-volume\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.508533 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508430    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d51139-f5f4-4efc-be76-4f78b7d147b9-tmp-dir\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.508533 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508530    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508563    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508598    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xslg\" (UniqueName: \"kubernetes.io/projected/5f99c87f-752c-44c4-8f70-d04ddc039dc2-kube-api-access-9xslg\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508637    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508665    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508691    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508730    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508756    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.508810 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508785    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jltww\" (UniqueName: \"kubernetes.io/projected/c3d51139-f5f4-4efc-be76-4f78b7d147b9-kube-api-access-jltww\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.509205 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.508905    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.509205 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.508986    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:35.509205 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.508995    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:35.509205 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.509092    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:36.009063735 +0000 UTC m=+34.709540705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:35.509205 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.509001    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:35.509465 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.509214    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:36.009196572 +0000 UTC m=+34.709673553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:35.509799 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.509757    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.509917 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.509810    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.512964 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.512942    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.513074 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.512942    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.520450 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.520429    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.520674 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.520649    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttnf4\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:35.521003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.520978    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xslg\" (UniqueName: \"kubernetes.io/projected/5f99c87f-752c-44c4-8f70-d04ddc039dc2-kube-api-access-9xslg\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:35.610139 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610092    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610166    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610241    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610255    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jltww\" (UniqueName: \"kubernetes.io/projected/c3d51139-f5f4-4efc-be76-4f78b7d147b9-kube-api-access-jltww\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610287    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610301    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:35.610334 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610327    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.610307302 +0000 UTC m=+66.310784278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:35.610626 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610351    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3d51139-f5f4-4efc-be76-4f78b7d147b9-config-volume\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.610626 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610364    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:35.610626 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610382    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d51139-f5f4-4efc-be76-4f78b7d147b9-tmp-dir\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.610626 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610405    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret podName:6c599fce-b3fe-4ac8-8abd-b2550678327d nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.610394543 +0000 UTC m=+66.310871513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret") pod "global-pull-secret-syncer-f647h" (UID: "6c599fce-b3fe-4ac8-8abd-b2550678327d") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:35.610626 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.610455    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:36.110434392 +0000 UTC m=+34.810911376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:35.610848 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610661    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3d51139-f5f4-4efc-be76-4f78b7d147b9-tmp-dir\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.610891 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.610871    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c3d51139-f5f4-4efc-be76-4f78b7d147b9-config-volume\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.618183 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.618158    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jltww\" (UniqueName: \"kubernetes.io/projected/c3d51139-f5f4-4efc-be76-4f78b7d147b9-kube-api-access-jltww\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:35.711779 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.711699    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:35.712016 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.711890    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:35.712016 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.711923    2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:35.712016 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.711937    2574 projected.go:194] Error preparing data for projected volume kube-api-access-62fdh for pod openshift-network-diagnostics/network-check-target-hg8s2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:35.712016 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:35.711991    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh podName:6bd5ec75-0653-405a-8d5e-134cca3ffa23 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.711973648 +0000 UTC m=+66.412450633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-62fdh" (UniqueName: "kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh") pod "network-check-target-hg8s2" (UID: "6bd5ec75-0653-405a-8d5e-134cca3ffa23") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:35.873177 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.873147    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:26:35.873967 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.873147    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:26:35.876014 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.875979    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:26:35.876161 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.876016    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:26:35.876161 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.875986    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 18:26:35.876161 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:35.875986    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g85kz\""
May 28 18:26:36.014099 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.014016    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:36.014099 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.014057    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:36.014312 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.014189    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:36.014312 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.014203    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:36.014312 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.014201    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:36.014312 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.014269    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:37.014246668 +0000 UTC m=+35.714723643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:36.014312 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.014288    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:37.014278525 +0000 UTC m=+35.714755501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:36.115239 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.115209    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:36.115393 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.115349    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:36.115436 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:36.115402    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:37.115388646 +0000 UTC m=+35.815865622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:36.869293 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.869252    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:26:36.871832 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.871811    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:26:36.871949 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:36.871887    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whbnm\""
May 28 18:26:37.022455 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:37.022228    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:37.022455 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:37.022426    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:37.022982 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.022335    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:37.022982 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.022534    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:39.022511104 +0000 UTC m=+37.722988081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:37.022982 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.022545    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:37.022982 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.022559    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:37.022982 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.022595    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:39.022584885 +0000 UTC m=+37.723061854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:37.086111 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:37.086079    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="f28a3d13e730577d99aaf3baa59ffc00a647b3236ae8574d10bb917069c9e4b9" exitCode=0
May 28 18:26:37.086246 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:37.086132    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"f28a3d13e730577d99aaf3baa59ffc00a647b3236ae8574d10bb917069c9e4b9"}
May 28 18:26:37.123542 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:37.123517    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:37.123658 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.123638    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:37.123726 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:37.123715    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:39.12369943 +0000 UTC m=+37.824176407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:38.090606 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:38.090573    2574 generic.go:358] "Generic (PLEG): container finished" podID="c6a2eb7e-ba5d-48a6-a223-fe80f229d218" containerID="227876d4e792948e11f310073143adf88fde51377b2934db3136aca9699310b9" exitCode=0
May 28 18:26:38.090978 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:38.090625    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerDied","Data":"227876d4e792948e11f310073143adf88fde51377b2934db3136aca9699310b9"}
May 28 18:26:39.037548 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:39.037507    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:39.037548 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:39.037546    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:39.037743 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.037648    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:39.037743 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.037650    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:39.037743 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.037715    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.037699971 +0000 UTC m=+41.738176941 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:39.037891 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.037660    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:39.037891 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.037809    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.037777514 +0000 UTC m=+41.738254483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:39.094997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:39.094965    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tt4df" event={"ID":"c6a2eb7e-ba5d-48a6-a223-fe80f229d218","Type":"ContainerStarted","Data":"1fe7bf7d8adfde711c4739faac3e5d8a2ab570523a1a54ab24433c96ef86bf81"}
May 28 18:26:39.119498 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:39.119450    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tt4df" podStartSLOduration=5.024467835 podStartE2EDuration="37.119436847s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:26:04.410646747 +0000 UTC m=+3.111123729" lastFinishedPulling="2026-05-28 18:26:36.505615771 +0000 UTC m=+35.206092741" observedRunningTime="2026-05-28 18:26:39.118274788 +0000 UTC m=+37.818751779" watchObservedRunningTime="2026-05-28 18:26:39.119436847 +0000 UTC m=+37.819913838"
May 28 18:26:39.138370 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:39.138342    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:39.138513 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.138494    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:39.138557 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:39.138552    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:43.138538326 +0000 UTC m=+41.839015296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:40.100264 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.100232    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"]
May 28 18:26:40.128003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.127964    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"]
May 28 18:26:40.140541 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.140506    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"]
May 28 18:26:40.140541 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.140542    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"]
May 28 18:26:40.140740 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.140557    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"]
May 28 18:26:40.140740 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.140614    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.141045 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.141021    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.144581 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144557    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 18:26:40.144696 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144582    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 18:26:40.144696 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144592    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ttpnh\""
May 28 18:26:40.144696 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144582    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 18:26:40.144696 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144582    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 18:26:40.144985 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.144967    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 18:26:40.154645 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.154622    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"]
May 28 18:26:40.154748 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.154733    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.158729 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.158707    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 28 18:26:40.158838 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.158732    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 28 18:26:40.159027 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.159014    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 28 18:26:40.159065 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.159028    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 28 18:26:40.246662 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.246625    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c88b19b-1f0d-45be-a113-6e1c43be73c5-tmp\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.246662 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.246666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c987cf-3c04-4e44-806c-da117af3f18d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.246924 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.246744    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c88b19b-1f0d-45be-a113-6e1c43be73c5-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.246924 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.246775    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cprh\" (UniqueName: \"kubernetes.io/projected/99c987cf-3c04-4e44-806c-da117af3f18d-kube-api-access-8cprh\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.246924 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.246915    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522cz\" (UniqueName: \"kubernetes.io/projected/6c88b19b-1f0d-45be-a113-6e1c43be73c5-kube-api-access-522cz\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.348211 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348176    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c88b19b-1f0d-45be-a113-6e1c43be73c5-tmp\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.348211 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348211    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c987cf-3c04-4e44-806c-da117af3f18d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.348429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348252    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c88b19b-1f0d-45be-a113-6e1c43be73c5-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.348429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348280    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8cprh\" (UniqueName: \"kubernetes.io/projected/99c987cf-3c04-4e44-806c-da117af3f18d-kube-api-access-8cprh\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.348429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348335    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6e733075-07b0-445c-a086-8cdd1afec9ab-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348431    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348528    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-522cz\" (UniqueName: \"kubernetes.io/projected/6c88b19b-1f0d-45be-a113-6e1c43be73c5-kube-api-access-522cz\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.348668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348596    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x84rn\" (UniqueName: \"kubernetes.io/projected/6e733075-07b0-445c-a086-8cdd1afec9ab-kube-api-access-x84rn\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.348668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.348614    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c88b19b-1f0d-45be-a113-6e1c43be73c5-tmp\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.352007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.351947    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6c88b19b-1f0d-45be-a113-6e1c43be73c5-klusterlet-config\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.352007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.351949    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99c987cf-3c04-4e44-806c-da117af3f18d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.356782 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.356744    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cprh\" (UniqueName: \"kubernetes.io/projected/99c987cf-3c04-4e44-806c-da117af3f18d-kube-api-access-8cprh\") pod \"managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh\" (UID: \"99c987cf-3c04-4e44-806c-da117af3f18d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.356903 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.356781    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522cz\" (UniqueName: \"kubernetes.io/projected/6c88b19b-1f0d-45be-a113-6e1c43be73c5-kube-api-access-522cz\") pod \"klusterlet-addon-workmgr-85c8947797-bvh98\" (UID: \"6c88b19b-1f0d-45be-a113-6e1c43be73c5\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.449685 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449645    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.449685 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449689    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.450009 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449719    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6e733075-07b0-445c-a086-8cdd1afec9ab-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.450009 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449746    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.450009 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449837    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.450009 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.449863    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x84rn\" (UniqueName: \"kubernetes.io/projected/6e733075-07b0-445c-a086-8cdd1afec9ab-kube-api-access-x84rn\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.450476 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.450447    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/6e733075-07b0-445c-a086-8cdd1afec9ab-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.452643 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.452614    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-ca\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.452821 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.452780    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.452925 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.452905    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.452960 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.452912    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6e733075-07b0-445c-a086-8cdd1afec9ab-hub\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.459125 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.459098    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x84rn\" (UniqueName: \"kubernetes.io/projected/6e733075-07b0-445c-a086-8cdd1afec9ab-kube-api-access-x84rn\") pod \"cluster-proxy-proxy-agent-5c5d486468-czrq2\" (UID: \"6e733075-07b0-445c-a086-8cdd1afec9ab\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.477830 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.477785    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"
May 28 18:26:40.482585 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.482562    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:40.488282 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.488215    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:26:40.647486 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.647305    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh"]
May 28 18:26:40.651175 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.651148    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"]
May 28 18:26:40.652233 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:40.652212    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99c987cf_3c04_4e44_806c_da117af3f18d.slice/crio-be6e26c30f02aec8081f49d946b90db5b62c4d33d28774f41aa2aee7eeceff00 WatchSource:0}: Error finding container be6e26c30f02aec8081f49d946b90db5b62c4d33d28774f41aa2aee7eeceff00: Status 404 returned error can't find the container with id be6e26c30f02aec8081f49d946b90db5b62c4d33d28774f41aa2aee7eeceff00
May 28 18:26:40.654173 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:40.654151    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c88b19b_1f0d_45be_a113_6e1c43be73c5.slice/crio-bfe87385bbc867728dd18706de5d23378157816a985a6dc3887cf0723c25ee66 WatchSource:0}: Error finding container bfe87385bbc867728dd18706de5d23378157816a985a6dc3887cf0723c25ee66: Status 404 returned error can't find the container with id bfe87385bbc867728dd18706de5d23378157816a985a6dc3887cf0723c25ee66
May 28 18:26:40.663610 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:40.663585    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"]
May 28 18:26:40.666320 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:26:40.666299    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e733075_07b0_445c_a086_8cdd1afec9ab.slice/crio-7b1b839e25fa392333529522036825784227eb74a86f1f33a8ac91967717dcf6 WatchSource:0}: Error finding container 7b1b839e25fa392333529522036825784227eb74a86f1f33a8ac91967717dcf6: Status 404 returned error can't find the container with id 7b1b839e25fa392333529522036825784227eb74a86f1f33a8ac91967717dcf6
May 28 18:26:41.099866 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:41.099768    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerStarted","Data":"7b1b839e25fa392333529522036825784227eb74a86f1f33a8ac91967717dcf6"}
May 28 18:26:41.100623 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:41.100594    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh" event={"ID":"99c987cf-3c04-4e44-806c-da117af3f18d","Type":"ContainerStarted","Data":"be6e26c30f02aec8081f49d946b90db5b62c4d33d28774f41aa2aee7eeceff00"}
May 28 18:26:41.101445 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:41.101426    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98" event={"ID":"6c88b19b-1f0d-45be-a113-6e1c43be73c5","Type":"ContainerStarted","Data":"bfe87385bbc867728dd18706de5d23378157816a985a6dc3887cf0723c25ee66"}
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:43.072179    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:43.072241    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.072331    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.072353    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.072367    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:43.072422 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.072415    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:51.072393375 +0000 UTC m=+49.772870363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:43.073102 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.072442    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:26:51.072432381 +0000 UTC m=+49.772909355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:43.172903 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:43.172871    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:43.173101 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.173035    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:43.173101 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:43.173091    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:51.173076694 +0000 UTC m=+49.873553669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:49.121593 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.121555    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerStarted","Data":"d7812066da9336aca28cd5b749a29519f062ae6bd62941beb2231bae760c7756"}
May 28 18:26:49.122742 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.122719    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh" event={"ID":"99c987cf-3c04-4e44-806c-da117af3f18d","Type":"ContainerStarted","Data":"6cbef70cc6033051ea3caac2947ce2455cf851e9c7fffca5f706d8fd126dfc2c"}
May 28 18:26:49.124023 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.124001    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98" event={"ID":"6c88b19b-1f0d-45be-a113-6e1c43be73c5","Type":"ContainerStarted","Data":"70abc4f5c4f29741a70bde2818058a1b741bfc0255fe10ba26c05f45c7c83959"}
May 28 18:26:49.124225 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.124211    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:49.125925 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.125907    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98"
May 28 18:26:49.137767 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.137732    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-58dbc98dcb-mhmsh" podStartSLOduration=1.402826663 podStartE2EDuration="9.137721813s" podCreationTimestamp="2026-05-28 18:26:40 +0000 UTC" firstStartedPulling="2026-05-28 18:26:40.654068058 +0000 UTC m=+39.354545034" lastFinishedPulling="2026-05-28 18:26:48.38896321 +0000 UTC m=+47.089440184" observedRunningTime="2026-05-28 18:26:49.136972155 +0000 UTC m=+47.837449146" watchObservedRunningTime="2026-05-28 18:26:49.137721813 +0000 UTC m=+47.838198804"
May 28 18:26:49.150722 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:49.150657    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-85c8947797-bvh98" podStartSLOduration=1.4025671530000001 podStartE2EDuration="9.150647001s" podCreationTimestamp="2026-05-28 18:26:40 +0000 UTC" firstStartedPulling="2026-05-28 18:26:40.656481392 +0000 UTC m=+39.356958377" lastFinishedPulling="2026-05-28 18:26:48.404561252 +0000 UTC m=+47.105038225" observedRunningTime="2026-05-28 18:26:49.149966928 +0000 UTC m=+47.850443920" watchObservedRunningTime="2026-05-28 18:26:49.150647001 +0000 UTC m=+47.851123993"
May 28 18:26:51.137208 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:51.137174    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:26:51.137208 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:51.137213    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:26:51.137613 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.137299    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:51.137613 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.137300    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:51.137613 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.137360    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.137345942 +0000 UTC m=+65.837822912 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:26:51.137613 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.137309    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:26:51.137613 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.137432    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.137421171 +0000 UTC m=+65.837898141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:26:51.238333 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:51.238295    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:26:51.238535 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.238516    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:51.238590 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:26:51.238581    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:07.238564575 +0000 UTC m=+65.939041545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:26:53.133887 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:53.133852    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerStarted","Data":"bd3785ba4e52a832cda1b61caf7e1ee5a435c97f99f91e9dfafe168cea17c45b"}
May 28 18:26:53.133887 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:53.133886    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerStarted","Data":"1f279fbef1de5f4d93948a2db1507826315fe5cabc6420c1679a806605d7e97f"}
May 28 18:26:53.151542 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:26:53.151493    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" podStartSLOduration=1.363373071 podStartE2EDuration="13.151476398s" podCreationTimestamp="2026-05-28 18:26:40 +0000 UTC" firstStartedPulling="2026-05-28 18:26:40.668134016 +0000 UTC m=+39.368610989" lastFinishedPulling="2026-05-28 18:26:52.456237327 +0000 UTC m=+51.156714316" observedRunningTime="2026-05-28 18:26:53.151035068 +0000 UTC m=+51.851512066" watchObservedRunningTime="2026-05-28 18:26:53.151476398 +0000 UTC m=+51.851953391"
May 28 18:27:01.082752 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:01.082717    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mkwsh"
May 28 18:27:06.609854 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:06.609823    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-llntx_239af890-ff27-498d-b394-5c3c8a59b8ac/dns-node-resolver/0.log"
May 28 18:27:07.160185 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.160149    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:27:07.160372 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.160277    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:27:07.160372 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.160292    2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:07.160372 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.160307    2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8fcf986b-zmw6x: secret "image-registry-tls" not found
May 28 18:27:07.160372 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.160354    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls podName:ff404238-4b46-4208-936c-bc311452a04f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:39.160338849 +0000 UTC m=+97.860815819 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls") pod "image-registry-8fcf986b-zmw6x" (UID: "ff404238-4b46-4208-936c-bc311452a04f") : secret "image-registry-tls" not found
May 28 18:27:07.160546 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.160375    2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:27:07.160546 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.160423    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert podName:5f99c87f-752c-44c4-8f70-d04ddc039dc2 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:39.160406747 +0000 UTC m=+97.860883731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert") pod "ingress-canary-2grkj" (UID: "5f99c87f-752c-44c4-8f70-d04ddc039dc2") : secret "canary-serving-cert" not found
May 28 18:27:07.260967 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.260934    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:07.261065 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.261052    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:27:07.261111 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.261103    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls podName:c3d51139-f5f4-4efc-be76-4f78b7d147b9 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:39.261089965 +0000 UTC m=+97.961566935 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls") pod "dns-default-qx5nz" (UID: "c3d51139-f5f4-4efc-be76-4f78b7d147b9") : secret "dns-default-metrics-tls" not found
May 28 18:27:07.609857 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.609832    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4ml8_ed201536-7fa5-4a2a-8c40-638237654c5c/node-ca/0.log"
May 28 18:27:07.664569 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.664534    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:27:07.664994 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.664634    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:27:07.667052 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.667025    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 18:27:07.667164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.667031    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:27:07.675147 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.675126    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:27:07.675223 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:07.675195    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs podName:8009cfe7-6d52-480c-9e82-d2379b9df5a5 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:11.67517555 +0000 UTC m=+130.375652533 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs") pod "network-metrics-daemon-9zf5t" (UID: "8009cfe7-6d52-480c-9e82-d2379b9df5a5") : secret "metrics-daemon-secret" not found
May 28 18:27:07.677655 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.677616    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6c599fce-b3fe-4ac8-8abd-b2550678327d-original-pull-secret\") pod \"global-pull-secret-syncer-f647h\" (UID: \"6c599fce-b3fe-4ac8-8abd-b2550678327d\") " pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:27:07.693187 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.693157    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f647h"
May 28 18:27:07.765587 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.765548    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:27:07.768442 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.768394    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:27:07.778840 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.778816    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:27:07.788973 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.788946    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fdh\" (UniqueName: \"kubernetes.io/projected/6bd5ec75-0653-405a-8d5e-134cca3ffa23-kube-api-access-62fdh\") pod \"network-check-target-hg8s2\" (UID: \"6bd5ec75-0653-405a-8d5e-134cca3ffa23\") " pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:27:07.810514 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.810479    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f647h"]
May 28 18:27:07.813829 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:07.813800    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c599fce_b3fe_4ac8_8abd_b2550678327d.slice/crio-4dff860cb22e5e9ef2d25ced454c481619ce11fd2679ca1b9b5eb5cfb181e550 WatchSource:0}: Error finding container 4dff860cb22e5e9ef2d25ced454c481619ce11fd2679ca1b9b5eb5cfb181e550: Status 404 returned error can't find the container with id 4dff860cb22e5e9ef2d25ced454c481619ce11fd2679ca1b9b5eb5cfb181e550
May 28 18:27:07.987105 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.987031    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g85kz\""
May 28 18:27:07.995005 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:07.994986    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:27:08.110047 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:08.110007    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hg8s2"]
May 28 18:27:08.112916 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:08.112888    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd5ec75_0653_405a_8d5e_134cca3ffa23.slice/crio-23b9598b1398b092c729922eab60aec4c5a24107134c33d5ef5ec8302af554a8 WatchSource:0}: Error finding container 23b9598b1398b092c729922eab60aec4c5a24107134c33d5ef5ec8302af554a8: Status 404 returned error can't find the container with id 23b9598b1398b092c729922eab60aec4c5a24107134c33d5ef5ec8302af554a8
May 28 18:27:08.161035 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:08.160998    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg8s2" event={"ID":"6bd5ec75-0653-405a-8d5e-134cca3ffa23","Type":"ContainerStarted","Data":"23b9598b1398b092c729922eab60aec4c5a24107134c33d5ef5ec8302af554a8"}
May 28 18:27:08.161942 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:08.161921    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f647h" event={"ID":"6c599fce-b3fe-4ac8-8abd-b2550678327d","Type":"ContainerStarted","Data":"4dff860cb22e5e9ef2d25ced454c481619ce11fd2679ca1b9b5eb5cfb181e550"}
May 28 18:27:11.171558 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:11.171520    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hg8s2" event={"ID":"6bd5ec75-0653-405a-8d5e-134cca3ffa23","Type":"ContainerStarted","Data":"e394d3637a0882b8deda74fa4ea3dddc0bef11abc921e7a0c495d11127b87d0e"}
May 28 18:27:11.171983 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:11.171651    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:27:11.188229 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:11.188183    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hg8s2" podStartSLOduration=66.290967936 podStartE2EDuration="1m9.188166741s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:27:08.114767367 +0000 UTC m=+66.815244337" lastFinishedPulling="2026-05-28 18:27:11.011966169 +0000 UTC m=+69.712443142" observedRunningTime="2026-05-28 18:27:11.187514108 +0000 UTC m=+69.887991102" watchObservedRunningTime="2026-05-28 18:27:11.188166741 +0000 UTC m=+69.888643733"
May 28 18:27:13.177969 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:13.177929    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f647h" event={"ID":"6c599fce-b3fe-4ac8-8abd-b2550678327d","Type":"ContainerStarted","Data":"2a56866a0d2ea4054f43be0717bc1dbaf9b7b1669c16f7189f32ac56014ff8fc"}
May 28 18:27:13.192423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:13.192378    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f647h" podStartSLOduration=66.505054263 podStartE2EDuration="1m11.19236256s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:27:07.815529537 +0000 UTC m=+66.516006507" lastFinishedPulling="2026-05-28 18:27:12.502837819 +0000 UTC m=+71.203314804" observedRunningTime="2026-05-28 18:27:13.191517693 +0000 UTC m=+71.891994685" watchObservedRunningTime="2026-05-28 18:27:13.19236256 +0000 UTC m=+71.892839552"
May 28 18:27:18.395029 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.394910    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cds5s"]
May 28 18:27:18.468969 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.468934    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cds5s"]
May 28 18:27:18.469125 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.469038    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.472170 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.472138    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qfd2r\""
May 28 18:27:18.472380 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.472356    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 18:27:18.472434 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.472398    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 18:27:18.472645 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.472629    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 18:27:18.472978 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.472963    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 18:27:18.547430 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.547403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.547563 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.547442    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-data-volume\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.547563 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.547474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nrj2\" (UniqueName: \"kubernetes.io/projected/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-api-access-5nrj2\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.547563 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.547551    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-crio-socket\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.547668 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.547610    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648299 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648221    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-data-volume\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648299 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648259    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5nrj2\" (UniqueName: \"kubernetes.io/projected/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-api-access-5nrj2\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648299 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648284    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-crio-socket\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648552 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648330    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648552 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648370    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648552 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648452    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-crio-socket\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648552 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:18.648474    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:18.648552 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:18.648542    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls podName:2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:19.148521837 +0000 UTC m=+77.848998819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cds5s" (UID: "2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:18.648719 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648603    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-data-volume\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.648841 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.648826    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:18.660014 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:18.659984    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nrj2\" (UniqueName: \"kubernetes.io/projected/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-kube-api-access-5nrj2\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:19.152162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:19.152125    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:19.152331 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:19.152268    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:19.152331 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:19.152327    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls podName:2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:20.152309944 +0000 UTC m=+78.852786914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cds5s" (UID: "2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:20.161645 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:20.161607    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:20.162032 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:20.161768    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:20.162032 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:20.161857    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls podName:2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:22.161838569 +0000 UTC m=+80.862315554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cds5s" (UID: "2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:22.176753 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:22.176703    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:22.177242 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:22.176875    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:22.177242 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:22.176939    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls podName:2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:26.176923509 +0000 UTC m=+84.877400479 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cds5s" (UID: "2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:26.209989 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:26.209934    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:26.210401 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:26.210095    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 28 18:27:26.210401 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:27:26.210156    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls podName:2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f nodeName:}" failed. No retries permitted until 2026-05-28 18:27:34.210136754 +0000 UTC m=+92.910613730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cds5s" (UID: "2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f") : secret "insights-runtime-extractor-tls" not found
May 28 18:27:34.273723 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:34.273679    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:34.275976 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:34.275956    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cds5s\" (UID: \"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f\") " pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:34.378268 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:34.378232    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cds5s"
May 28 18:27:34.503635 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:34.503601    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cds5s"]
May 28 18:27:34.506969 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:34.506940    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cd8d3f7_7a0c_4aee_8781_70f38eef2d9f.slice/crio-b76e5481f474bceb6c7c906bc6e3829f18ae50c57556e81be1f5b66c9c9aa81e WatchSource:0}: Error finding container b76e5481f474bceb6c7c906bc6e3829f18ae50c57556e81be1f5b66c9c9aa81e: Status 404 returned error can't find the container with id b76e5481f474bceb6c7c906bc6e3829f18ae50c57556e81be1f5b66c9c9aa81e
May 28 18:27:35.233439 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:35.233412    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cds5s" event={"ID":"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f","Type":"ContainerStarted","Data":"92f469e018e325998e5805b45e969de57ab1e6728dec7a65401ac32a383231ec"}
May 28 18:27:35.233538 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:35.233447    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cds5s" event={"ID":"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f","Type":"ContainerStarted","Data":"b76e5481f474bceb6c7c906bc6e3829f18ae50c57556e81be1f5b66c9c9aa81e"}
May 28 18:27:36.237776 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:36.237738    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cds5s" event={"ID":"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f","Type":"ContainerStarted","Data":"c81d2ea394ee2bf19a0035799ed7cb377e02dffcacc3895ef66a0fde59fbffa3"}
May 28 18:27:37.242343 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:37.242306    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cds5s" event={"ID":"2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f","Type":"ContainerStarted","Data":"cd5a3e12101dd8c66e700d05ec5fca44bce2e2abf75137e1e834b44b20483d98"}
May 28 18:27:37.262164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:37.262120    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cds5s" podStartSLOduration=17.029808218 podStartE2EDuration="19.262108357s" podCreationTimestamp="2026-05-28 18:27:18 +0000 UTC" firstStartedPulling="2026-05-28 18:27:34.562150647 +0000 UTC m=+93.262627621" lastFinishedPulling="2026-05-28 18:27:36.794450775 +0000 UTC m=+95.494927760" observedRunningTime="2026-05-28 18:27:37.261715355 +0000 UTC m=+95.962192347" watchObservedRunningTime="2026-05-28 18:27:37.262108357 +0000 UTC m=+95.962585348"
May 28 18:27:39.214465 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.214434    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:27:39.214902 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.214473    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:27:39.216853 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.216824    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"image-registry-8fcf986b-zmw6x\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") " pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:27:39.216951 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.216824    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f99c87f-752c-44c4-8f70-d04ddc039dc2-cert\") pod \"ingress-canary-2grkj\" (UID: \"5f99c87f-752c-44c4-8f70-d04ddc039dc2\") " pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:27:39.315249 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.315200    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:39.317465 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.317439    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3d51139-f5f4-4efc-be76-4f78b7d147b9-metrics-tls\") pod \"dns-default-qx5nz\" (UID: \"c3d51139-f5f4-4efc-be76-4f78b7d147b9\") " pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:39.437890 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.437785    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-brjsz\""
May 28 18:27:39.445873 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.445845    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:27:39.449112 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.449091    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lsslr\""
May 28 18:27:39.456271 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.456252    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2grkj"
May 28 18:27:39.557517 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.557276    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z2d7l\""
May 28 18:27:39.565997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.564094    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:39.610976 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.610950    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:27:39.615566 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:39.615356    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff404238_4b46_4208_936c_bc311452a04f.slice/crio-d2e025580fd1ed569b9ef2646d2a2d92100bd7e5041e54bc98740c22e462bb72 WatchSource:0}: Error finding container d2e025580fd1ed569b9ef2646d2a2d92100bd7e5041e54bc98740c22e462bb72: Status 404 returned error can't find the container with id d2e025580fd1ed569b9ef2646d2a2d92100bd7e5041e54bc98740c22e462bb72
May 28 18:27:39.615974 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.615776    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2grkj"]
May 28 18:27:39.618183 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:39.618099    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f99c87f_752c_44c4_8f70_d04ddc039dc2.slice/crio-06a9f29362e70d8625641e21603b6ad092e84f95f2e2d035efc3e513bf57edb2 WatchSource:0}: Error finding container 06a9f29362e70d8625641e21603b6ad092e84f95f2e2d035efc3e513bf57edb2: Status 404 returned error can't find the container with id 06a9f29362e70d8625641e21603b6ad092e84f95f2e2d035efc3e513bf57edb2
May 28 18:27:39.695119 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:39.695046    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx5nz"]
May 28 18:27:39.697871 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:39.697841    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d51139_f5f4_4efc_be76_4f78b7d147b9.slice/crio-57362e6d76779b34b4d59fb9f9dc336e6bae21e11f01610f48c4003cee66e038 WatchSource:0}: Error finding container 57362e6d76779b34b4d59fb9f9dc336e6bae21e11f01610f48c4003cee66e038: Status 404 returned error can't find the container with id 57362e6d76779b34b4d59fb9f9dc336e6bae21e11f01610f48c4003cee66e038
May 28 18:27:40.251522 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.251481    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2grkj" event={"ID":"5f99c87f-752c-44c4-8f70-d04ddc039dc2","Type":"ContainerStarted","Data":"06a9f29362e70d8625641e21603b6ad092e84f95f2e2d035efc3e513bf57edb2"}
May 28 18:27:40.252773 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.252747    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" event={"ID":"ff404238-4b46-4208-936c-bc311452a04f","Type":"ContainerStarted","Data":"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"}
May 28 18:27:40.252903 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.252778    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" event={"ID":"ff404238-4b46-4208-936c-bc311452a04f","Type":"ContainerStarted","Data":"d2e025580fd1ed569b9ef2646d2a2d92100bd7e5041e54bc98740c22e462bb72"}
May 28 18:27:40.252903 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.252864    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:27:40.253995 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.253969    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx5nz" event={"ID":"c3d51139-f5f4-4efc-be76-4f78b7d147b9","Type":"ContainerStarted","Data":"57362e6d76779b34b4d59fb9f9dc336e6bae21e11f01610f48c4003cee66e038"}
May 28 18:27:40.276406 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:40.276358    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" podStartSLOduration=98.276342812 podStartE2EDuration="1m38.276342812s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:27:40.274856968 +0000 UTC m=+98.975333961" watchObservedRunningTime="2026-05-28 18:27:40.276342812 +0000 UTC m=+98.976819803"
May 28 18:27:42.177560 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.177526    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hg8s2"
May 28 18:27:42.260521 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.260480    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx5nz" event={"ID":"c3d51139-f5f4-4efc-be76-4f78b7d147b9","Type":"ContainerStarted","Data":"94ed315a286e7553fce05d542b7d9b3378825e560b74294f250450ee7d053856"}
May 28 18:27:42.260521 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.260519    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx5nz" event={"ID":"c3d51139-f5f4-4efc-be76-4f78b7d147b9","Type":"ContainerStarted","Data":"12656bdeee64b69446e3370275c596b8f2402ad0613a5bd1db439351bf324bbc"}
May 28 18:27:42.260761 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.260650    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:42.261781 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.261756    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2grkj" event={"ID":"5f99c87f-752c-44c4-8f70-d04ddc039dc2","Type":"ContainerStarted","Data":"4a7924a88fdcc5b1caae94484d88310ac1093ce526d743139a40f6c15cbc30e5"}
May 28 18:27:42.276593 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.276540    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qx5nz" podStartSLOduration=65.463042689 podStartE2EDuration="1m7.276523337s" podCreationTimestamp="2026-05-28 18:26:35 +0000 UTC" firstStartedPulling="2026-05-28 18:27:39.699574861 +0000 UTC m=+98.400051834" lastFinishedPulling="2026-05-28 18:27:41.51305551 +0000 UTC m=+100.213532482" observedRunningTime="2026-05-28 18:27:42.276019987 +0000 UTC m=+100.976496979" watchObservedRunningTime="2026-05-28 18:27:42.276523337 +0000 UTC m=+100.977000335"
May 28 18:27:42.292090 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:42.292049    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2grkj" podStartSLOduration=65.395387616 podStartE2EDuration="1m7.292037702s" podCreationTimestamp="2026-05-28 18:26:35 +0000 UTC" firstStartedPulling="2026-05-28 18:27:39.619950585 +0000 UTC m=+98.320427555" lastFinishedPulling="2026-05-28 18:27:41.516600668 +0000 UTC m=+100.217077641" observedRunningTime="2026-05-28 18:27:42.291386688 +0000 UTC m=+100.991863681" watchObservedRunningTime="2026-05-28 18:27:42.292037702 +0000 UTC m=+100.992514694"
May 28 18:27:49.063841 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.063804    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6tq8g"]
May 28 18:27:49.066427 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.066406    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.069383 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.069363    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 18:27:49.069383 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.069378    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 18:27:49.070083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.070062    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nsxzf\""
May 28 18:27:49.070184 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.070131    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 18:27:49.070184 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.070165    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 18:27:49.070457 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.070438    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 18:27:49.071447 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.071429    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 18:27:49.086983 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.086963    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-tls\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.086988    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-metrics-client-ca\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087033    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-textfile\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087188 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087110    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-wtmp\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087188 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087164    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087249 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-root\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087249 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087220    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-sys\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.087325 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.087251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28v5w\" (UniqueName: \"kubernetes.io/projected/3797f25f-126f-48f3-a235-3e74841217a8-kube-api-access-28v5w\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188501 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188467    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-28v5w\" (UniqueName: \"kubernetes.io/projected/3797f25f-126f-48f3-a235-3e74841217a8-kube-api-access-28v5w\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188663 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188508    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-tls\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188663 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188533    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-metrics-client-ca\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188833 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188708    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188833 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188750    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-textfile\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.188833 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188819    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-wtmp\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189011 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188865    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189011 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188901    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-root\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189011 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.188939    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-sys\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189151 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189017    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-sys\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189151 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189018    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-wtmp\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189151 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189069    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-textfile\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189151 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189074    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3797f25f-126f-48f3-a235-3e74841217a8-root\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189292 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189213    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-metrics-client-ca\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.189387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.189368    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.191074 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.191053    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.191074 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.191065    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3797f25f-126f-48f3-a235-3e74841217a8-node-exporter-tls\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.200769 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.200746    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28v5w\" (UniqueName: \"kubernetes.io/projected/3797f25f-126f-48f3-a235-3e74841217a8-kube-api-access-28v5w\") pod \"node-exporter-6tq8g\" (UID: \"3797f25f-126f-48f3-a235-3e74841217a8\") " pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.376748 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:49.376710    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6tq8g"
May 28 18:27:49.385592 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:27:49.385555    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3797f25f_126f_48f3_a235_3e74841217a8.slice/crio-44b644f995fc0f84e25b0224cda4b470aaf2b06da2ef6fd05bca80ec23dbe7b0 WatchSource:0}: Error finding container 44b644f995fc0f84e25b0224cda4b470aaf2b06da2ef6fd05bca80ec23dbe7b0: Status 404 returned error can't find the container with id 44b644f995fc0f84e25b0224cda4b470aaf2b06da2ef6fd05bca80ec23dbe7b0
May 28 18:27:50.280838 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:50.280778    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tq8g" event={"ID":"3797f25f-126f-48f3-a235-3e74841217a8","Type":"ContainerStarted","Data":"44b644f995fc0f84e25b0224cda4b470aaf2b06da2ef6fd05bca80ec23dbe7b0"}
May 28 18:27:51.284663 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:51.284628    2574 generic.go:358] "Generic (PLEG): container finished" podID="3797f25f-126f-48f3-a235-3e74841217a8" containerID="1e1826ac4fb57e262a9fc89f7e6d19391c606b9367b2f239f3c71b30465a2c13" exitCode=0
May 28 18:27:51.285056 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:51.284675    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tq8g" event={"ID":"3797f25f-126f-48f3-a235-3e74841217a8","Type":"ContainerDied","Data":"1e1826ac4fb57e262a9fc89f7e6d19391c606b9367b2f239f3c71b30465a2c13"}
May 28 18:27:52.265713 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:52.265675    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qx5nz"
May 28 18:27:52.288736 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:52.288702    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tq8g" event={"ID":"3797f25f-126f-48f3-a235-3e74841217a8","Type":"ContainerStarted","Data":"1536aecadd2c7f29fe80730723697176f9a8b3ec31a9e588fef4ffa320d250f2"}
May 28 18:27:52.288736 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:52.288737    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6tq8g" event={"ID":"3797f25f-126f-48f3-a235-3e74841217a8","Type":"ContainerStarted","Data":"2507d2524eb4d21e758837914152e6cef23802b85bf2654f209af5c8e28a6e7e"}
May 28 18:27:52.310553 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:27:52.310508    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6tq8g" podStartSLOduration=2.277955777 podStartE2EDuration="3.310494329s" podCreationTimestamp="2026-05-28 18:27:49 +0000 UTC" firstStartedPulling="2026-05-28 18:27:49.387411954 +0000 UTC m=+108.087888923" lastFinishedPulling="2026-05-28 18:27:50.419950502 +0000 UTC m=+109.120427475" observedRunningTime="2026-05-28 18:27:52.309757614 +0000 UTC m=+111.010234606" watchObservedRunningTime="2026-05-28 18:27:52.310494329 +0000 UTC m=+111.010971365"
May 28 18:28:01.261306 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:01.261271    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:28:02.861692 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:02.861655    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:28:11.756575 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:11.756528    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:28:11.758784 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:11.758763    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8009cfe7-6d52-480c-9e82-d2379b9df5a5-metrics-certs\") pod \"network-metrics-daemon-9zf5t\" (UID: \"8009cfe7-6d52-480c-9e82-d2379b9df5a5\") " pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:28:11.980337 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:11.980305    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-whbnm\""
May 28 18:28:11.989167 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:11.989149    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9zf5t"
May 28 18:28:12.111463 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:12.111428    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9zf5t"]
May 28 18:28:12.114192 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:28:12.114157    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8009cfe7_6d52_480c_9e82_d2379b9df5a5.slice/crio-f91e659af7de77d62eeb845d33d48892b213df6cc4711cadcf1663f42fd31f11 WatchSource:0}: Error finding container f91e659af7de77d62eeb845d33d48892b213df6cc4711cadcf1663f42fd31f11: Status 404 returned error can't find the container with id f91e659af7de77d62eeb845d33d48892b213df6cc4711cadcf1663f42fd31f11
May 28 18:28:12.337821 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:12.337727    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zf5t" event={"ID":"8009cfe7-6d52-480c-9e82-d2379b9df5a5","Type":"ContainerStarted","Data":"f91e659af7de77d62eeb845d33d48892b213df6cc4711cadcf1663f42fd31f11"}
May 28 18:28:13.342343 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:13.342252    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zf5t" event={"ID":"8009cfe7-6d52-480c-9e82-d2379b9df5a5","Type":"ContainerStarted","Data":"7217aa7bc3f9d0270845af2d42f04b7208cca6e44d6a1dd8bf4750d58cb934f7"}
May 28 18:28:13.342343 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:13.342290    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9zf5t" event={"ID":"8009cfe7-6d52-480c-9e82-d2379b9df5a5","Type":"ContainerStarted","Data":"594da33fffd67e440037dc5bca30b7c89487928bdf9ffad2192946c7e7e3646d"}
May 28 18:28:13.358732 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:13.358683    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9zf5t" podStartSLOduration=130.421127593 podStartE2EDuration="2m11.35866772s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:28:12.115940339 +0000 UTC m=+130.816417324" lastFinishedPulling="2026-05-28 18:28:13.053480481 +0000 UTC m=+131.753957451" observedRunningTime="2026-05-28 18:28:13.357725339 +0000 UTC m=+132.058202332" watchObservedRunningTime="2026-05-28 18:28:13.35866772 +0000 UTC m=+132.059144712"
May 28 18:28:20.489627 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:20.489580    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" podUID="6e733075-07b0-445c-a086-8cdd1afec9ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:28:27.879737 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:27.879674    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" podUID="ff404238-4b46-4208-936c-bc311452a04f" containerName="registry" containerID="cri-o://7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8" gracePeriod=30
May 28 18:28:28.113952 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.113930    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:28:28.166171 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166096    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166171 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166154    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166180    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttnf4\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166214    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166247    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166285    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166314    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166364 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166348    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted\") pod \"ff404238-4b46-4208-936c-bc311452a04f\" (UID: \"ff404238-4b46-4208-936c-bc311452a04f\") "
May 28 18:28:28.166822 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166766    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:28:28.166946 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.166896    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:28:28.168585 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.168547    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:28:28.168689 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.168580    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:28:28.168689 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.168666    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:28:28.168905 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.168867    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4" (OuterVolumeSpecName: "kube-api-access-ttnf4") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "kube-api-access-ttnf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:28:28.169032 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.169011    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:28:28.175473 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.175452    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ff404238-4b46-4208-936c-bc311452a04f" (UID: "ff404238-4b46-4208-936c-bc311452a04f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:28:28.267069 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267040    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-image-registry-private-configuration\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267069 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267068    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-bound-sa-token\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267080    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-trusted-ca\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267089    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ff404238-4b46-4208-936c-bc311452a04f-ca-trust-extracted\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267098    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ff404238-4b46-4208-936c-bc311452a04f-installation-pull-secrets\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267109    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-registry-tls\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267117    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttnf4\" (UniqueName: \"kubernetes.io/projected/ff404238-4b46-4208-936c-bc311452a04f-kube-api-access-ttnf4\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.267258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.267126    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ff404238-4b46-4208-936c-bc311452a04f-registry-certificates\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:28:28.383238 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.383204    2574 generic.go:358] "Generic (PLEG): container finished" podID="ff404238-4b46-4208-936c-bc311452a04f" containerID="7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8" exitCode=0
May 28 18:28:28.383387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.383272    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x"
May 28 18:28:28.383387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.383288    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" event={"ID":"ff404238-4b46-4208-936c-bc311452a04f","Type":"ContainerDied","Data":"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"}
May 28 18:28:28.383387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.383327    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8fcf986b-zmw6x" event={"ID":"ff404238-4b46-4208-936c-bc311452a04f","Type":"ContainerDied","Data":"d2e025580fd1ed569b9ef2646d2a2d92100bd7e5041e54bc98740c22e462bb72"}
May 28 18:28:28.383387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.383342    2574 scope.go:117] "RemoveContainer" containerID="7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"
May 28 18:28:28.390937 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.390917    2574 scope.go:117] "RemoveContainer" containerID="7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"
May 28 18:28:28.391199 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:28:28.391175    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8\": container with ID starting with 7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8 not found: ID does not exist" containerID="7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"
May 28 18:28:28.391293 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.391206    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8"} err="failed to get container status \"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8\": rpc error: code = NotFound desc = could not find container \"7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8\": container with ID starting with 7f5733aa83aadefa97efb6e0b89edc7eb445d42eeebb1bd17c6f5a6eacc529c8 not found: ID does not exist"
May 28 18:28:28.402982 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.402956    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:28:28.406134 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:28.406108    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8fcf986b-zmw6x"]
May 28 18:28:29.873865 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:29.873832    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff404238-4b46-4208-936c-bc311452a04f" path="/var/lib/kubelet/pods/ff404238-4b46-4208-936c-bc311452a04f/volumes"
May 28 18:28:30.490112 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:30.490073    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" podUID="6e733075-07b0-445c-a086-8cdd1afec9ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:28:40.489681 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:40.489641    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" podUID="6e733075-07b0-445c-a086-8cdd1afec9ab" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:28:40.490073 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:40.489711    2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2"
May 28 18:28:40.490206 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:40.490188    2574 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"bd3785ba4e52a832cda1b61caf7e1ee5a435c97f99f91e9dfafe168cea17c45b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 28 18:28:40.490248 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:40.490225    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" podUID="6e733075-07b0-445c-a086-8cdd1afec9ab" containerName="service-proxy" containerID="cri-o://bd3785ba4e52a832cda1b61caf7e1ee5a435c97f99f91e9dfafe168cea17c45b" gracePeriod=30
May 28 18:28:41.417131 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:41.417095    2574 generic.go:358] "Generic (PLEG): container finished" podID="6e733075-07b0-445c-a086-8cdd1afec9ab" containerID="bd3785ba4e52a832cda1b61caf7e1ee5a435c97f99f91e9dfafe168cea17c45b" exitCode=2
May 28 18:28:41.417307 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:41.417146    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerDied","Data":"bd3785ba4e52a832cda1b61caf7e1ee5a435c97f99f91e9dfafe168cea17c45b"}
May 28 18:28:41.417307 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:28:41.417176    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c5d486468-czrq2" event={"ID":"6e733075-07b0-445c-a086-8cdd1afec9ab","Type":"ContainerStarted","Data":"5eefcd70b1c878d4d84178aaf292c70aba98f412c550de5d0b8110675ecdb769"}
May 28 18:31:01.751921 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:31:01.751893    2574 kubelet.go:1628] "Image garbage collection succeeded"
May 28 18:32:23.778056 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.778021    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-dxghm"]
May 28 18:32:23.778525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.778252    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff404238-4b46-4208-936c-bc311452a04f" containerName="registry"
May 28 18:32:23.778525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.778262    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff404238-4b46-4208-936c-bc311452a04f" containerName="registry"
May 28 18:32:23.778525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.778309    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff404238-4b46-4208-936c-bc311452a04f" containerName="registry"
May 28 18:32:23.781160 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.781145    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:23.783462 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.783437    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7n7t9\""
May 28 18:32:23.783570 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.783480    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 18:32:23.783570 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.783493    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 18:32:23.788263 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.788240    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-dxghm"]
May 28 18:32:23.974590 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.974559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:23.974745 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:23.974608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9g87\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-kube-api-access-s9g87\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.075083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.075013    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9g87\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-kube-api-access-s9g87\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.075083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.075066    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.083142 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.083122    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.083260 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.083206    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9g87\" (UniqueName: \"kubernetes.io/projected/f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b-kube-api-access-s9g87\") pod \"cert-manager-cainjector-68b757865b-dxghm\" (UID: \"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b\") " pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.089998 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.089981    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm"
May 28 18:32:24.207418 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.207288    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-dxghm"]
May 28 18:32:24.211565 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:32:24.211528    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf673eb1f_aedb_4ca5_9780_1ffd9de4ff0b.slice/crio-8c4dfaa4d82f37f241e58718d77ec674670d84e66056bdf0088ab73476c03a06 WatchSource:0}: Error finding container 8c4dfaa4d82f37f241e58718d77ec674670d84e66056bdf0088ab73476c03a06: Status 404 returned error can't find the container with id 8c4dfaa4d82f37f241e58718d77ec674670d84e66056bdf0088ab73476c03a06
May 28 18:32:24.212944 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.212923    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:32:24.950215 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:24.950177    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm" event={"ID":"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b","Type":"ContainerStarted","Data":"8c4dfaa4d82f37f241e58718d77ec674670d84e66056bdf0088ab73476c03a06"}
May 28 18:32:27.958751 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:27.958717    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm" event={"ID":"f673eb1f-aedb-4ca5-9780-1ffd9de4ff0b","Type":"ContainerStarted","Data":"103937d0c0af8c4e01df0c2e133eb3ad7392ec05065463945ef4f9e2a6191d9e"}
May 28 18:32:54.008387 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.008315    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-dxghm" podStartSLOduration=27.895002235 podStartE2EDuration="31.008294697s" podCreationTimestamp="2026-05-28 18:32:23 +0000 UTC" firstStartedPulling="2026-05-28 18:32:24.213060319 +0000 UTC m=+382.913537290" lastFinishedPulling="2026-05-28 18:32:27.326352782 +0000 UTC m=+386.026829752" observedRunningTime="2026-05-28 18:32:27.977777615 +0000 UTC m=+386.678254609" watchObservedRunningTime="2026-05-28 18:32:54.008294697 +0000 UTC m=+412.708771693"
May 28 18:32:54.008924 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.008903    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"]
May 28 18:32:54.011785 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.011768    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.014532 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.014501    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 18:32:54.014705 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.014518    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 18:32:54.014705 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.014584    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 18:32:54.014893 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.014589    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 18:32:54.015118 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.015101    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6948x\""
May 28 18:32:54.024173 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.024152    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"]
May 28 18:32:54.074580 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.074549    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.074723 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.074593    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.074723 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.074622    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8b4n\" (UniqueName: \"kubernetes.io/projected/9cb96d74-b15c-4261-b1a8-422d9764ca06-kube-api-access-g8b4n\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.175641 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.175608    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.175834 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.175657    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g8b4n\" (UniqueName: \"kubernetes.io/projected/9cb96d74-b15c-4261-b1a8-422d9764ca06-kube-api-access-g8b4n\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.175834 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.175710    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.178068 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.178044    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-webhook-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.178158 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.178105    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9cb96d74-b15c-4261-b1a8-422d9764ca06-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.186325 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.186296    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8b4n\" (UniqueName: \"kubernetes.io/projected/9cb96d74-b15c-4261-b1a8-422d9764ca06-kube-api-access-g8b4n\") pod \"opendatahub-operator-controller-manager-b658c4654-glz86\" (UID: \"9cb96d74-b15c-4261-b1a8-422d9764ca06\") " pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.322505 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.322423    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:54.448353 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:54.448319    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"]
May 28 18:32:54.454176 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:32:54.454143    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb96d74_b15c_4261_b1a8_422d9764ca06.slice/crio-bcebfef77aacdf4cfffd39d3ed01647968abfd2ebd0da1c74b4c8b577e57d5e2 WatchSource:0}: Error finding container bcebfef77aacdf4cfffd39d3ed01647968abfd2ebd0da1c74b4c8b577e57d5e2: Status 404 returned error can't find the container with id bcebfef77aacdf4cfffd39d3ed01647968abfd2ebd0da1c74b4c8b577e57d5e2
May 28 18:32:55.028054 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:55.028016    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86" event={"ID":"9cb96d74-b15c-4261-b1a8-422d9764ca06","Type":"ContainerStarted","Data":"bcebfef77aacdf4cfffd39d3ed01647968abfd2ebd0da1c74b4c8b577e57d5e2"}
May 28 18:32:58.037335 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:58.037292    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86" event={"ID":"9cb96d74-b15c-4261-b1a8-422d9764ca06","Type":"ContainerStarted","Data":"5f9908346d1fd13668a9bdb9311644f34fc730581c2b83ae402b6fbf24f3aeb5"}
May 28 18:32:58.037726 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:58.037363    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:32:58.057595 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:32:58.057539    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86" podStartSLOduration=2.479256702 podStartE2EDuration="5.057524343s" podCreationTimestamp="2026-05-28 18:32:53 +0000 UTC" firstStartedPulling="2026-05-28 18:32:54.455334221 +0000 UTC m=+413.155811192" lastFinishedPulling="2026-05-28 18:32:57.033601863 +0000 UTC m=+415.734078833" observedRunningTime="2026-05-28 18:32:58.057195771 +0000 UTC m=+416.757672763" watchObservedRunningTime="2026-05-28 18:32:58.057524343 +0000 UTC m=+416.758001334"
May 28 18:33:09.042022 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:09.041991    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b658c4654-glz86"
May 28 18:33:11.780452 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.780413    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59c6767894-4c52b"]
May 28 18:33:11.785248 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.785232    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.787578 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.787550    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 18:33:11.788361 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.788340    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 18:33:11.788448 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.788426    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 18:33:11.788505 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.788429    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-psgtr\""
May 28 18:33:11.788505 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.788432    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 18:33:11.790825 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.790765    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c6767894-4c52b"]
May 28 18:33:11.896434 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.896408    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkp6r\" (UniqueName: \"kubernetes.io/projected/ef0d14fb-544d-44d4-a4a0-e37533aa224c-kube-api-access-xkp6r\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.896598 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.896468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tls-certs\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.896598 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.896494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tmp\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.997803 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.997764    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xkp6r\" (UniqueName: \"kubernetes.io/projected/ef0d14fb-544d-44d4-a4a0-e37533aa224c-kube-api-access-xkp6r\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.997975 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.997881    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tls-certs\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:11.997975 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:11.997903    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tmp\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:12.000037 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:12.000013    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tmp\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:12.000231 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:12.000215    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef0d14fb-544d-44d4-a4a0-e37533aa224c-tls-certs\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:12.005354 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:12.005328    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkp6r\" (UniqueName: \"kubernetes.io/projected/ef0d14fb-544d-44d4-a4a0-e37533aa224c-kube-api-access-xkp6r\") pod \"kube-auth-proxy-59c6767894-4c52b\" (UID: \"ef0d14fb-544d-44d4-a4a0-e37533aa224c\") " pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:12.094688 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:12.094607    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b"
May 28 18:33:12.217751 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:12.217723    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59c6767894-4c52b"]
May 28 18:33:12.220264 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:33:12.220224    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0d14fb_544d_44d4_a4a0_e37533aa224c.slice/crio-eb7e980489987daaf409863741c1fac9b5a6b844d5e60e7204273e0c575b3ede WatchSource:0}: Error finding container eb7e980489987daaf409863741c1fac9b5a6b844d5e60e7204273e0c575b3ede: Status 404 returned error can't find the container with id eb7e980489987daaf409863741c1fac9b5a6b844d5e60e7204273e0c575b3ede
May 28 18:33:13.078122 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:13.078076    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b" event={"ID":"ef0d14fb-544d-44d4-a4a0-e37533aa224c","Type":"ContainerStarted","Data":"eb7e980489987daaf409863741c1fac9b5a6b844d5e60e7204273e0c575b3ede"}
May 28 18:33:15.394537 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.394454    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xq4l5"]
May 28 18:33:15.398679 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.398656    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:15.400987 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.400957    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kdm88\""
May 28 18:33:15.400987 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.400970    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 18:33:15.406450 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.406406    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xq4l5"]
May 28 18:33:15.529985 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.529936    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kr9h\" (UniqueName: \"kubernetes.io/projected/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-kube-api-access-6kr9h\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:15.529985 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.529984    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:15.631422 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.631383    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6kr9h\" (UniqueName: \"kubernetes.io/projected/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-kube-api-access-6kr9h\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:15.631610 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.631431    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:15.631610 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:33:15.631546    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 18:33:15.631728 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:33:15.631618    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert podName:b111eb3c-da72-4f75-b0f0-7c1bdfe656dc nodeName:}" failed. No retries permitted until 2026-05-28 18:33:16.131598477 +0000 UTC m=+434.832075447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert") pod "odh-model-controller-858dbf95b8-xq4l5" (UID: "b111eb3c-da72-4f75-b0f0-7c1bdfe656dc") : secret "odh-model-controller-webhook-cert" not found
May 28 18:33:15.640593 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:15.640538    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kr9h\" (UniqueName: \"kubernetes.io/projected/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-kube-api-access-6kr9h\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:16.089201 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:16.089112    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b" event={"ID":"ef0d14fb-544d-44d4-a4a0-e37533aa224c","Type":"ContainerStarted","Data":"b8e7bb5f89a458106e48cf24253e523d028b8febd909988675257dbc149283d2"}
May 28 18:33:16.105384 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:16.105332    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59c6767894-4c52b" podStartSLOduration=1.551786582 podStartE2EDuration="5.105320533s" podCreationTimestamp="2026-05-28 18:33:11 +0000 UTC" firstStartedPulling="2026-05-28 18:33:12.222347438 +0000 UTC m=+430.922824411" lastFinishedPulling="2026-05-28 18:33:15.775881381 +0000 UTC m=+434.476358362" observedRunningTime="2026-05-28 18:33:16.103879519 +0000 UTC m=+434.804356523" watchObservedRunningTime="2026-05-28 18:33:16.105320533 +0000 UTC m=+434.805797526"
May 28 18:33:16.136178 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:16.136148    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:16.136341 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:33:16.136260    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 18:33:16.136341 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:33:16.136316    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert podName:b111eb3c-da72-4f75-b0f0-7c1bdfe656dc nodeName:}" failed. No retries permitted until 2026-05-28 18:33:17.136298758 +0000 UTC m=+435.836775730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert") pod "odh-model-controller-858dbf95b8-xq4l5" (UID: "b111eb3c-da72-4f75-b0f0-7c1bdfe656dc") : secret "odh-model-controller-webhook-cert" not found
May 28 18:33:17.145684 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:17.145639    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:17.148281 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:17.148257    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b111eb3c-da72-4f75-b0f0-7c1bdfe656dc-cert\") pod \"odh-model-controller-858dbf95b8-xq4l5\" (UID: \"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc\") " pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:17.211938 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:17.211901    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:17.340715 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:17.340645    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-xq4l5"]
May 28 18:33:17.343741 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:33:17.343714    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb111eb3c_da72_4f75_b0f0_7c1bdfe656dc.slice/crio-cd4010a834b47ec318954f4c4d16bb2fde502d7d1233b39c959707bde11b2f3a WatchSource:0}: Error finding container cd4010a834b47ec318954f4c4d16bb2fde502d7d1233b39c959707bde11b2f3a: Status 404 returned error can't find the container with id cd4010a834b47ec318954f4c4d16bb2fde502d7d1233b39c959707bde11b2f3a
May 28 18:33:18.096143 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:18.096111    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5" event={"ID":"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc","Type":"ContainerStarted","Data":"cd4010a834b47ec318954f4c4d16bb2fde502d7d1233b39c959707bde11b2f3a"}
May 28 18:33:21.106537 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.106505    2574 generic.go:358] "Generic (PLEG): container finished" podID="b111eb3c-da72-4f75-b0f0-7c1bdfe656dc" containerID="20ee76122e623355f0fb6fa76bd90740d65ce20687281753eb7fd2dca41bce86" exitCode=1
May 28 18:33:21.106919 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.106557    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5" event={"ID":"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc","Type":"ContainerDied","Data":"20ee76122e623355f0fb6fa76bd90740d65ce20687281753eb7fd2dca41bce86"}
May 28 18:33:21.106919 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.106759    2574 scope.go:117] "RemoveContainer" containerID="20ee76122e623355f0fb6fa76bd90740d65ce20687281753eb7fd2dca41bce86"
May 28 18:33:21.432671 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.432645    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5ljj6"]
May 28 18:33:21.436838 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.436820    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.438966 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.438947    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 18:33:21.439065 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.438967    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tz69m\""
May 28 18:33:21.444074 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.444053    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5ljj6"]
May 28 18:33:21.588203 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.588157    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtb2d\" (UniqueName: \"kubernetes.io/projected/4b647287-efd4-42ac-898b-c54b2b7d2968-kube-api-access-mtb2d\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.588397 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.588219    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b647287-efd4-42ac-898b-c54b2b7d2968-cert\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.689326 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.689220    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtb2d\" (UniqueName: \"kubernetes.io/projected/4b647287-efd4-42ac-898b-c54b2b7d2968-kube-api-access-mtb2d\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.689326 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.689272    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b647287-efd4-42ac-898b-c54b2b7d2968-cert\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.691681 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.691654    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4b647287-efd4-42ac-898b-c54b2b7d2968-cert\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.697200 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.697174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtb2d\" (UniqueName: \"kubernetes.io/projected/4b647287-efd4-42ac-898b-c54b2b7d2968-kube-api-access-mtb2d\") pod \"kserve-controller-manager-856948b99f-5ljj6\" (UID: \"4b647287-efd4-42ac-898b-c54b2b7d2968\") " pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.759993 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.759963    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:21.924441 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:21.924409    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-5ljj6"]
May 28 18:33:21.927192 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:33:21.927162    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b647287_efd4_42ac_898b_c54b2b7d2968.slice/crio-36fce83cc92d40b51d6b7125516ed84390feaa7d62821d2bad8dc89db201ba92 WatchSource:0}: Error finding container 36fce83cc92d40b51d6b7125516ed84390feaa7d62821d2bad8dc89db201ba92: Status 404 returned error can't find the container with id 36fce83cc92d40b51d6b7125516ed84390feaa7d62821d2bad8dc89db201ba92
May 28 18:33:22.109864 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:22.109829    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6" event={"ID":"4b647287-efd4-42ac-898b-c54b2b7d2968","Type":"ContainerStarted","Data":"36fce83cc92d40b51d6b7125516ed84390feaa7d62821d2bad8dc89db201ba92"}
May 28 18:33:22.111388 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:22.111360    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5" event={"ID":"b111eb3c-da72-4f75-b0f0-7c1bdfe656dc","Type":"ContainerStarted","Data":"4b4f9105dea6bfa97162fefdb44f4299772276845a8cd6bd68e3de516c3e65be"}
May 28 18:33:22.111550 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:22.111539    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:22.129758 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:22.129715    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5" podStartSLOduration=3.069483773 podStartE2EDuration="7.129701347s" podCreationTimestamp="2026-05-28 18:33:15 +0000 UTC" firstStartedPulling="2026-05-28 18:33:17.345179047 +0000 UTC m=+436.045656018" lastFinishedPulling="2026-05-28 18:33:21.405396618 +0000 UTC m=+440.105873592" observedRunningTime="2026-05-28 18:33:22.128737003 +0000 UTC m=+440.829213994" watchObservedRunningTime="2026-05-28 18:33:22.129701347 +0000 UTC m=+440.830178365"
May 28 18:33:26.176134 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.176098    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"]
May 28 18:33:26.180869 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.180842    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.183678 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.183651    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 18:33:26.183839 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.183816    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2cw64\""
May 28 18:33:26.183839 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.183825    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 18:33:26.192631 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.192609    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"]
May 28 18:33:26.325543 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.325504    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trzv5\" (UniqueName: \"kubernetes.io/projected/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-kube-api-access-trzv5\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.325686 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.325544    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.426635 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.426540    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trzv5\" (UniqueName: \"kubernetes.io/projected/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-kube-api-access-trzv5\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.426635 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.426584    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.429180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.429152    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-operator-config\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.438042 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.438001    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trzv5\" (UniqueName: \"kubernetes.io/projected/33e77f47-3e17-40e4-9dbf-3a75e6c07e94-kube-api-access-trzv5\") pod \"servicemesh-operator3-55f49c5f94-bb8kp\" (UID: \"33e77f47-3e17-40e4-9dbf-3a75e6c07e94\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.491174 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.491146    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:26.637777 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:26.637742    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"]
May 28 18:33:26.640967 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:33:26.640939    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e77f47_3e17_40e4_9dbf_3a75e6c07e94.slice/crio-104dadebdec31f062f9efd72439780a75e4198b32cb469b9bd0055387cec111f WatchSource:0}: Error finding container 104dadebdec31f062f9efd72439780a75e4198b32cb469b9bd0055387cec111f: Status 404 returned error can't find the container with id 104dadebdec31f062f9efd72439780a75e4198b32cb469b9bd0055387cec111f
May 28 18:33:27.126094 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:27.126060    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6" event={"ID":"4b647287-efd4-42ac-898b-c54b2b7d2968","Type":"ContainerStarted","Data":"c639411742ff6475609b6b576c17b510cbda9e071a0eeaf14a98517ef7898ce7"}
May 28 18:33:27.126275 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:27.126201    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:33:27.127260 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:27.127234    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp" event={"ID":"33e77f47-3e17-40e4-9dbf-3a75e6c07e94","Type":"ContainerStarted","Data":"104dadebdec31f062f9efd72439780a75e4198b32cb469b9bd0055387cec111f"}
May 28 18:33:27.142204 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:27.142161    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6" podStartSLOduration=1.823099181 podStartE2EDuration="6.142146582s" podCreationTimestamp="2026-05-28 18:33:21 +0000 UTC" firstStartedPulling="2026-05-28 18:33:21.928455704 +0000 UTC m=+440.628932673" lastFinishedPulling="2026-05-28 18:33:26.24750309 +0000 UTC m=+444.947980074" observedRunningTime="2026-05-28 18:33:27.141745352 +0000 UTC m=+445.842222345" watchObservedRunningTime="2026-05-28 18:33:27.142146582 +0000 UTC m=+445.842623577"
May 28 18:33:31.140944 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:31.140890    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp" event={"ID":"33e77f47-3e17-40e4-9dbf-3a75e6c07e94","Type":"ContainerStarted","Data":"9f7389fe94297aeb738bf6d7a3c8ebe749aa2595c80a085c48383be20fc90641"}
May 28 18:33:31.140944 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:31.140953    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:31.174711 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:31.174646    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp" podStartSLOduration=1.609543234 podStartE2EDuration="5.174630202s" podCreationTimestamp="2026-05-28 18:33:26 +0000 UTC" firstStartedPulling="2026-05-28 18:33:26.643735922 +0000 UTC m=+445.344212895" lastFinishedPulling="2026-05-28 18:33:30.20882289 +0000 UTC m=+448.909299863" observedRunningTime="2026-05-28 18:33:31.172237839 +0000 UTC m=+449.872714833" watchObservedRunningTime="2026-05-28 18:33:31.174630202 +0000 UTC m=+449.875107196"
May 28 18:33:33.116860 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:33.116819    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-xq4l5"
May 28 18:33:42.146904 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:42.146873    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-bb8kp"
May 28 18:33:58.135380 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:33:58.135348    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-5ljj6"
May 28 18:34:12.327703 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.327668    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:12.338997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.338970    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:12.339135 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.339092    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:12.341214 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.341186    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 18:34:12.341348 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.341188    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bdv52\""
May 28 18:34:12.342071 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.342053    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 18:34:12.365706 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.365672    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztqt6\" (UniqueName: \"kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6\") pod \"kuadrant-operator-catalog-s8xrf\" (UID: \"f65db404-8b96-4944-aab1-d90f16733f71\") " pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:12.466357 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.466321    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ztqt6\" (UniqueName: \"kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6\") pod \"kuadrant-operator-catalog-s8xrf\" (UID: \"f65db404-8b96-4944-aab1-d90f16733f71\") " pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:12.476891 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.476861    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztqt6\" (UniqueName: \"kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6\") pod \"kuadrant-operator-catalog-s8xrf\" (UID: \"f65db404-8b96-4944-aab1-d90f16733f71\") " pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:12.649017 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.648985    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:12.694739 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.694708    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:12.771321 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.771292    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:12.774184 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:34:12.774152    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf65db404_8b96_4944_aab1_d90f16733f71.slice/crio-03503c0c17a2d4a6ed61503a887602cec1bf2e39247f0c37dedd067add5e4e06 WatchSource:0}: Error finding container 03503c0c17a2d4a6ed61503a887602cec1bf2e39247f0c37dedd067add5e4e06: Status 404 returned error can't find the container with id 03503c0c17a2d4a6ed61503a887602cec1bf2e39247f0c37dedd067add5e4e06
May 28 18:34:12.905448 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.905367    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2slqk"]
May 28 18:34:12.907876 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.907859    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:12.914820 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.914768    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2slqk"]
May 28 18:34:12.971575 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:12.971536    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vlg\" (UniqueName: \"kubernetes.io/projected/1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16-kube-api-access-s6vlg\") pod \"kuadrant-operator-catalog-2slqk\" (UID: \"1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16\") " pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:13.073258 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.073209    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vlg\" (UniqueName: \"kubernetes.io/projected/1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16-kube-api-access-s6vlg\") pod \"kuadrant-operator-catalog-2slqk\" (UID: \"1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16\") " pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:13.081358 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.081331    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vlg\" (UniqueName: \"kubernetes.io/projected/1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16-kube-api-access-s6vlg\") pod \"kuadrant-operator-catalog-2slqk\" (UID: \"1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16\") " pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:13.218446 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.218374    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:13.286985 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.286933    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" event={"ID":"f65db404-8b96-4944-aab1-d90f16733f71","Type":"ContainerStarted","Data":"03503c0c17a2d4a6ed61503a887602cec1bf2e39247f0c37dedd067add5e4e06"}
May 28 18:34:13.315525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.315444    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"]
May 28 18:34:13.319526 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.319437    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.322461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.321979    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 18:34:13.322461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.322029    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mq7bt\""
May 28 18:34:13.322461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.322174    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 18:34:13.322461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.322263    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 18:34:13.322461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.322327    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 18:34:13.331529 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.331482    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"]
May 28 18:34:13.365372 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.365345    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2slqk"]
May 28 18:34:13.369211 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:34:13.369180    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dcf8da7_84c0_4acb_82d6_33e4e5ab9d16.slice/crio-d6618ddb7962754c084dd73c6c1cee5ea6f4b30507806a58090e7c54b2ce8fac WatchSource:0}: Error finding container d6618ddb7962754c084dd73c6c1cee5ea6f4b30507806a58090e7c54b2ce8fac: Status 404 returned error can't find the container with id d6618ddb7962754c084dd73c6c1cee5ea6f4b30507806a58090e7c54b2ce8fac
May 28 18:34:13.378103 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121e191-94ce-43b8-8c4c-e8703b197c8c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378220 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378323 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378323 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378257    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378415 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378324    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378415 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378379    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87s7v\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-kube-api-access-87s7v\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.378415 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.378405    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.478920 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.478844    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.478920 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.478894    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.478930    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.478962    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87s7v\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-kube-api-access-87s7v\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.478993    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.479033    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121e191-94ce-43b8-8c4c-e8703b197c8c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479149 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.479102    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.479850 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.479820    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.481464 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.481440    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.481693 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.481675    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121e191-94ce-43b8-8c4c-e8703b197c8c-local-certs\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.481762 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.481724    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-cacerts\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.481762 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.481742    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.488290 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.488266    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-istio-token\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.488290 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.488281    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87s7v\" (UniqueName: \"kubernetes.io/projected/0121e191-94ce-43b8-8c4c-e8703b197c8c-kube-api-access-87s7v\") pod \"istiod-openshift-gateway-798958bb55-vqvmc\" (UID: \"0121e191-94ce-43b8-8c4c-e8703b197c8c\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:13.635658 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:13.635618    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:14.007394 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:14.007284    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"]
May 28 18:34:14.025185 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:34:14.025154    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0121e191_94ce_43b8_8c4c_e8703b197c8c.slice/crio-a44fe6afa663adc3b030d4a299d79f93eaabafa0d535594ea1948d580dc909e9 WatchSource:0}: Error finding container a44fe6afa663adc3b030d4a299d79f93eaabafa0d535594ea1948d580dc909e9: Status 404 returned error can't find the container with id a44fe6afa663adc3b030d4a299d79f93eaabafa0d535594ea1948d580dc909e9
May 28 18:34:14.291704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:14.291618    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2slqk" event={"ID":"1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16","Type":"ContainerStarted","Data":"d6618ddb7962754c084dd73c6c1cee5ea6f4b30507806a58090e7c54b2ce8fac"}
May 28 18:34:14.292847 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:14.292815    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc" event={"ID":"0121e191-94ce-43b8-8c4c-e8703b197c8c","Type":"ContainerStarted","Data":"a44fe6afa663adc3b030d4a299d79f93eaabafa0d535594ea1948d580dc909e9"}
May 28 18:34:15.298679 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.298503    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2slqk" event={"ID":"1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16","Type":"ContainerStarted","Data":"f9b62e8f309b0ecd713b61954e86489298fc6c3bc13bf2b8281e90f0a0b192dd"}
May 28 18:34:15.300135 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.300106    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" event={"ID":"f65db404-8b96-4944-aab1-d90f16733f71","Type":"ContainerStarted","Data":"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"}
May 28 18:34:15.300276 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.300223    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" podUID="f65db404-8b96-4944-aab1-d90f16733f71" containerName="registry-server" containerID="cri-o://6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56" gracePeriod=2
May 28 18:34:15.313605 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.313555    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2slqk" podStartSLOduration=1.73823876 podStartE2EDuration="3.31354107s" podCreationTimestamp="2026-05-28 18:34:12 +0000 UTC" firstStartedPulling="2026-05-28 18:34:13.370468908 +0000 UTC m=+492.070945878" lastFinishedPulling="2026-05-28 18:34:14.945771211 +0000 UTC m=+493.646248188" observedRunningTime="2026-05-28 18:34:15.312685085 +0000 UTC m=+494.013162080" watchObservedRunningTime="2026-05-28 18:34:15.31354107 +0000 UTC m=+494.014018062"
May 28 18:34:15.329073 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.329023    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" podStartSLOduration=1.162203099 podStartE2EDuration="3.329007181s" podCreationTimestamp="2026-05-28 18:34:12 +0000 UTC" firstStartedPulling="2026-05-28 18:34:12.775554153 +0000 UTC m=+491.476031145" lastFinishedPulling="2026-05-28 18:34:14.942358253 +0000 UTC m=+493.642835227" observedRunningTime="2026-05-28 18:34:15.327700219 +0000 UTC m=+494.028177212" watchObservedRunningTime="2026-05-28 18:34:15.329007181 +0000 UTC m=+494.029484198"
May 28 18:34:15.566333 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.566308    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:15.698619 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.698587    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztqt6\" (UniqueName: \"kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6\") pod \"f65db404-8b96-4944-aab1-d90f16733f71\" (UID: \"f65db404-8b96-4944-aab1-d90f16733f71\") "
May 28 18:34:15.701100 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.701056    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6" (OuterVolumeSpecName: "kube-api-access-ztqt6") pod "f65db404-8b96-4944-aab1-d90f16733f71" (UID: "f65db404-8b96-4944-aab1-d90f16733f71"). InnerVolumeSpecName "kube-api-access-ztqt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:34:15.799378 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:15.799343    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztqt6\" (UniqueName: \"kubernetes.io/projected/f65db404-8b96-4944-aab1-d90f16733f71-kube-api-access-ztqt6\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:34:16.305115 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.305035    2574 generic.go:358] "Generic (PLEG): container finished" podID="f65db404-8b96-4944-aab1-d90f16733f71" containerID="6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56" exitCode=0
May 28 18:34:16.305591 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.305126    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf"
May 28 18:34:16.305591 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.305135    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" event={"ID":"f65db404-8b96-4944-aab1-d90f16733f71","Type":"ContainerDied","Data":"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"}
May 28 18:34:16.305591 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.305175    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s8xrf" event={"ID":"f65db404-8b96-4944-aab1-d90f16733f71","Type":"ContainerDied","Data":"03503c0c17a2d4a6ed61503a887602cec1bf2e39247f0c37dedd067add5e4e06"}
May 28 18:34:16.305591 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.305192    2574 scope.go:117] "RemoveContainer" containerID="6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"
May 28 18:34:16.320543 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.320512    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:16.323620 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.323592    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s8xrf"]
May 28 18:34:16.767385 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.767361    2574 scope.go:117] "RemoveContainer" containerID="6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"
May 28 18:34:16.767702 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:34:16.767682    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56\": container with ID starting with 6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56 not found: ID does not exist" containerID="6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"
May 28 18:34:16.767755 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.767713    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56"} err="failed to get container status \"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56\": rpc error: code = NotFound desc = could not find container \"6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56\": container with ID starting with 6d23a22fb5e55c66b561881a9b7e2a9efe7c531c4402566e297c58db37557c56 not found: ID does not exist"
May 28 18:34:16.825128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.825082    2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 28 18:34:16.825247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:16.825162    2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
May 28 18:34:17.316393 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.316355    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc" event={"ID":"0121e191-94ce-43b8-8c4c-e8703b197c8c","Type":"ContainerStarted","Data":"c3f51f2c5a346fc55031c873dee6c79aa20ac5f218f6945a20b0b62043147a87"}
May 28 18:34:17.316881 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.316597    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:17.318383 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.318348    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-vqvmc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 28 18:34:17.318534 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.318418    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc" podUID="0121e191-94ce-43b8-8c4c-e8703b197c8c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 18:34:17.338565 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.338493    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc" podStartSLOduration=1.541352522 podStartE2EDuration="4.338441148s" podCreationTimestamp="2026-05-28 18:34:13 +0000 UTC" firstStartedPulling="2026-05-28 18:34:14.027776839 +0000 UTC m=+492.728253809" lastFinishedPulling="2026-05-28 18:34:16.82486545 +0000 UTC m=+495.525342435" observedRunningTime="2026-05-28 18:34:17.336410524 +0000 UTC m=+496.036887518" watchObservedRunningTime="2026-05-28 18:34:17.338441148 +0000 UTC m=+496.038918144"
May 28 18:34:17.875987 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:17.875946    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f65db404-8b96-4944-aab1-d90f16733f71" path="/var/lib/kubelet/pods/f65db404-8b96-4944-aab1-d90f16733f71/volumes"
May 28 18:34:18.321561 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:18.321481    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-vqvmc"
May 28 18:34:23.219172 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:23.219142    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:23.219559 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:23.219184    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:23.239913 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:23.239890    2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:23.356301 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:23.356265    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2slqk"
May 28 18:34:44.759806 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.759749    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ql2tr"]
May 28 18:34:44.760244 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.760160    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f65db404-8b96-4944-aab1-d90f16733f71" containerName="registry-server"
May 28 18:34:44.760244 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.760178    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f65db404-8b96-4944-aab1-d90f16733f71" containerName="registry-server"
May 28 18:34:44.760324 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.760266    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f65db404-8b96-4944-aab1-d90f16733f71" containerName="registry-server"
May 28 18:34:44.772396 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.772363    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:44.773704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.773669    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ql2tr"]
May 28 18:34:44.776577 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.776554    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-66cf7\""
May 28 18:34:44.933758 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:44.933722    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9v9\" (UniqueName: \"kubernetes.io/projected/72ece883-0670-4769-9625-e747624fef01-kube-api-access-cd9v9\") pod \"authorino-operator-657f44b778-ql2tr\" (UID: \"72ece883-0670-4769-9625-e747624fef01\") " pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:45.035126 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:45.035038    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9v9\" (UniqueName: \"kubernetes.io/projected/72ece883-0670-4769-9625-e747624fef01-kube-api-access-cd9v9\") pod \"authorino-operator-657f44b778-ql2tr\" (UID: \"72ece883-0670-4769-9625-e747624fef01\") " pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:45.042367 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:45.042336    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9v9\" (UniqueName: \"kubernetes.io/projected/72ece883-0670-4769-9625-e747624fef01-kube-api-access-cd9v9\") pod \"authorino-operator-657f44b778-ql2tr\" (UID: \"72ece883-0670-4769-9625-e747624fef01\") " pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:45.084481 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:45.084412    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:45.208583 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:45.208559    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-ql2tr"]
May 28 18:34:45.211046 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:34:45.211009    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ece883_0670_4769_9625_e747624fef01.slice/crio-c4a9921f6a6a3d4116dbee5e162968b2f7b598d780c9d6a1ba62c3694475d6bb WatchSource:0}: Error finding container c4a9921f6a6a3d4116dbee5e162968b2f7b598d780c9d6a1ba62c3694475d6bb: Status 404 returned error can't find the container with id c4a9921f6a6a3d4116dbee5e162968b2f7b598d780c9d6a1ba62c3694475d6bb
May 28 18:34:45.400148 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:45.400111    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr" event={"ID":"72ece883-0670-4769-9625-e747624fef01","Type":"ContainerStarted","Data":"c4a9921f6a6a3d4116dbee5e162968b2f7b598d780c9d6a1ba62c3694475d6bb"}
May 28 18:34:47.407044 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:47.407017    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr" event={"ID":"72ece883-0670-4769-9625-e747624fef01","Type":"ContainerStarted","Data":"ac9ae1568a1b617f4e99073a847123254d3b60320fabc1552c6528978d77c73c"}
May 28 18:34:47.407347 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:47.407152    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:58.412506 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:58.412471    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr"
May 28 18:34:58.429202 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:34:58.429154    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-ql2tr" podStartSLOduration=12.336307072 podStartE2EDuration="14.42914045s" podCreationTimestamp="2026-05-28 18:34:44 +0000 UTC" firstStartedPulling="2026-05-28 18:34:45.212889186 +0000 UTC m=+523.913366156" lastFinishedPulling="2026-05-28 18:34:47.305722564 +0000 UTC m=+526.006199534" observedRunningTime="2026-05-28 18:34:47.426838757 +0000 UTC m=+526.127315749" watchObservedRunningTime="2026-05-28 18:34:58.42914045 +0000 UTC m=+537.129617464"
May 28 18:35:07.815877 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.815840    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"]
May 28 18:35:07.820030 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.820013    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:07.824128 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.824108    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2vbj5\""
May 28 18:35:07.835960 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.835939    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"]
May 28 18:35:07.915460 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.915429    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt2zx\" (UniqueName: \"kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:07.915628 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:07.915470    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.016058 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.016014    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qt2zx\" (UniqueName: \"kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.016249 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.016068    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.016492 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.016469    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.025256 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.025231    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt2zx\" (UniqueName: \"kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.129030 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.129003    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:08.253997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.253960    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"]
May 28 18:35:08.257052 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:35:08.257025    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ddc9895_c53d_4957_9ce3_0fe961cb4b70.slice/crio-fff704e02b34934b400381098a53969abca275094c92a5e15d1b2e93c1a03f7a WatchSource:0}: Error finding container fff704e02b34934b400381098a53969abca275094c92a5e15d1b2e93c1a03f7a: Status 404 returned error can't find the container with id fff704e02b34934b400381098a53969abca275094c92a5e15d1b2e93c1a03f7a
May 28 18:35:08.471867 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.471776    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" event={"ID":"7ddc9895-c53d-4957-9ce3-0fe961cb4b70","Type":"ContainerStarted","Data":"fff704e02b34934b400381098a53969abca275094c92a5e15d1b2e93c1a03f7a"}
May 28 18:35:08.503145 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.503114    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"]
May 28 18:35:08.511215 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.511187    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"]
May 28 18:35:08.523998 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.523974    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:08.528642 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.528618    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.541838 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.541777    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:08.621663 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.621631    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz4z8\" (UniqueName: \"kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.621827 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.621694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.722719 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.722633    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.722719 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.722693    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bz4z8\" (UniqueName: \"kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.723049 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.723027    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.734692 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.734662    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz4z8\" (UniqueName: \"kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.840480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.840431    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:08.990124 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:08.990067    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:08.992825 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:35:08.992781    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded05e6ee_c0cf_4f95_8808_3c631c88efb6.slice/crio-cafe3ad1809b7f2d2a72284a2bab6e78e4591db9e34cc86c260db9b7e1bc9ecc WatchSource:0}: Error finding container cafe3ad1809b7f2d2a72284a2bab6e78e4591db9e34cc86c260db9b7e1bc9ecc: Status 404 returned error can't find the container with id cafe3ad1809b7f2d2a72284a2bab6e78e4591db9e34cc86c260db9b7e1bc9ecc
May 28 18:35:09.477962 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:09.477922    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" event={"ID":"ed05e6ee-c0cf-4f95-8808-3c631c88efb6","Type":"ContainerStarted","Data":"cafe3ad1809b7f2d2a72284a2bab6e78e4591db9e34cc86c260db9b7e1bc9ecc"}
May 28 18:35:12.490419 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:12.490394    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" event={"ID":"ed05e6ee-c0cf-4f95-8808-3c631c88efb6","Type":"ContainerStarted","Data":"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"}
May 28 18:35:12.490701 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:12.490525    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:12.510040 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:12.509989    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" podStartSLOduration=1.091820136 podStartE2EDuration="4.509967916s" podCreationTimestamp="2026-05-28 18:35:08 +0000 UTC" firstStartedPulling="2026-05-28 18:35:08.995388167 +0000 UTC m=+547.695865138" lastFinishedPulling="2026-05-28 18:35:12.413535932 +0000 UTC m=+551.114012918" observedRunningTime="2026-05-28 18:35:12.50806252 +0000 UTC m=+551.208539512" watchObservedRunningTime="2026-05-28 18:35:12.509967916 +0000 UTC m=+551.210444909"
May 28 18:35:13.494598 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.494540    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" containerName="manager" containerID="cri-o://effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4" gracePeriod=2
May 28 18:35:13.497316 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.497283    2574 status_manager.go:895] "Failed to get status for pod" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object"
May 28 18:35:13.726208 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.726181    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:13.728294 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.728269    2574 status_manager.go:895] "Failed to get status for pod" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object"
May 28 18:35:13.769714 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.769636    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume\") pod \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") "
May 28 18:35:13.769714 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.769680    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt2zx\" (UniqueName: \"kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx\") pod \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\" (UID: \"7ddc9895-c53d-4957-9ce3-0fe961cb4b70\") "
May 28 18:35:13.769913 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.769875    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ddc9895-c53d-4957-9ce3-0fe961cb4b70" (UID: "7ddc9895-c53d-4957-9ce3-0fe961cb4b70"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:13.771687 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.771663    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx" (OuterVolumeSpecName: "kube-api-access-qt2zx") pod "7ddc9895-c53d-4957-9ce3-0fe961cb4b70" (UID: "7ddc9895-c53d-4957-9ce3-0fe961cb4b70"). InnerVolumeSpecName "kube-api-access-qt2zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:13.870211 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.870180    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt2zx\" (UniqueName: \"kubernetes.io/projected/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-kube-api-access-qt2zx\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:35:13.870211 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.870206    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ddc9895-c53d-4957-9ce3-0fe961cb4b70-extensions-socket-volume\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:35:13.874245 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:13.874218    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" path="/var/lib/kubelet/pods/7ddc9895-c53d-4957-9ce3-0fe961cb4b70/volumes"
May 28 18:35:14.499181 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.499142    2574 generic.go:358] "Generic (PLEG): container finished" podID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" containerID="effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4" exitCode=2
May 28 18:35:14.499609 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.499195    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2"
May 28 18:35:14.499609 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.499247    2574 scope.go:117] "RemoveContainer" containerID="effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4"
May 28 18:35:14.501624 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.501595    2574 status_manager.go:895] "Failed to get status for pod" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object"
May 28 18:35:14.503405 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.503381    2574 status_manager.go:895] "Failed to get status for pod" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-drnb2" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-drnb2\" is forbidden: User \"system:node:ip-10-0-139-21.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-21.ec2.internal' and this object"
May 28 18:35:14.506692 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.506674    2574 scope.go:117] "RemoveContainer" containerID="effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4"
May 28 18:35:14.506961 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:35:14.506939    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4\": container with ID starting with effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4 not found: ID does not exist" containerID="effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4"
May 28 18:35:14.507021 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:14.506969    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4"} err="failed to get container status \"effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4\": rpc error: code = NotFound desc = could not find container \"effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4\": container with ID starting with effabcf57a5c82d52d31ca27c09b8e9733528168bb00e0aaa4d4f3ad14acada4 not found: ID does not exist"
May 28 18:35:23.496370 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:23.496337    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:35.951780 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:35.951739    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:35.952343 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:35.952149    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" podUID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" containerName="manager" containerID="cri-o://432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c" gracePeriod=10
May 28 18:35:36.204413 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.204358    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:36.245720 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.245693    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume\") pod \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") "
May 28 18:35:36.245897 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.245727    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz4z8\" (UniqueName: \"kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8\") pod \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\" (UID: \"ed05e6ee-c0cf-4f95-8808-3c631c88efb6\") "
May 28 18:35:36.246148 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.246119    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed05e6ee-c0cf-4f95-8808-3c631c88efb6" (UID: "ed05e6ee-c0cf-4f95-8808-3c631c88efb6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:36.247739 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.247712    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8" (OuterVolumeSpecName: "kube-api-access-bz4z8") pod "ed05e6ee-c0cf-4f95-8808-3c631c88efb6" (UID: "ed05e6ee-c0cf-4f95-8808-3c631c88efb6"). InnerVolumeSpecName "kube-api-access-bz4z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:36.346428 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.346398    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-extensions-socket-volume\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:35:36.346428 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.346426    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz4z8\" (UniqueName: \"kubernetes.io/projected/ed05e6ee-c0cf-4f95-8808-3c631c88efb6-kube-api-access-bz4z8\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:35:36.576457 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.576368    2574 generic.go:358] "Generic (PLEG): container finished" podID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" containerID="432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c" exitCode=0
May 28 18:35:36.576457 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.576427    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" event={"ID":"ed05e6ee-c0cf-4f95-8808-3c631c88efb6","Type":"ContainerDied","Data":"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"}
May 28 18:35:36.576457 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.576438    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"
May 28 18:35:36.576686 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.576460    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh" event={"ID":"ed05e6ee-c0cf-4f95-8808-3c631c88efb6","Type":"ContainerDied","Data":"cafe3ad1809b7f2d2a72284a2bab6e78e4591db9e34cc86c260db9b7e1bc9ecc"}
May 28 18:35:36.576686 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.576483    2574 scope.go:117] "RemoveContainer" containerID="432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"
May 28 18:35:36.584759 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.584741    2574 scope.go:117] "RemoveContainer" containerID="432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"
May 28 18:35:36.585010 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:35:36.584990    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c\": container with ID starting with 432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c not found: ID does not exist" containerID="432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"
May 28 18:35:36.585065 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.585018    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c"} err="failed to get container status \"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c\": rpc error: code = NotFound desc = could not find container \"432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c\": container with ID starting with 432db42bdd2217608783a227b570fe49dca8c6f3a0fc3e75a79134bf2d7a9a6c not found: ID does not exist"
May 28 18:35:36.596417 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.596393    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:36.604147 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:36.604119    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-m2vdh"]
May 28 18:35:37.873427 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:37.873393    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" path="/var/lib/kubelet/pods/ed05e6ee-c0cf-4f95-8808-3c631c88efb6/volumes"
May 28 18:35:53.327832 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.327781    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328192    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" containerName="manager"
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328209    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" containerName="manager"
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328224    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" containerName="manager"
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328232    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" containerName="manager"
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328317    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ed05e6ee-c0cf-4f95-8808-3c631c88efb6" containerName="manager"
May 28 18:35:53.328379 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.328331    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ddc9895-c53d-4957-9ce3-0fe961cb4b70" containerName="manager"
May 28 18:35:53.330116 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.330095    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.332222 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.332202    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 18:35:53.332318 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.332253    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7lct8\""
May 28 18:35:53.339831 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.339805    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:35:53.425978 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.425934    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:35:53.485876 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.485811    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w24lf\" (UniqueName: \"kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.486042 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.485892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.586349 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.586275    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.586349 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.586325    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w24lf\" (UniqueName: \"kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.586916 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.586898    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.593751 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.593727    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w24lf\" (UniqueName: \"kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf\") pod \"limitador-limitador-7d549b5b-z7ccs\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") " pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.640866 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.640839    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:53.763446 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:53.763412    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:35:53.766819 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:35:53.766764    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb093d082_0972_4c82_a636_34a1d70509c1.slice/crio-bb80f6f0a88004a6ca118449806acbc86a6a3fa456b4058d33d5f044f818086e WatchSource:0}: Error finding container bb80f6f0a88004a6ca118449806acbc86a6a3fa456b4058d33d5f044f818086e: Status 404 returned error can't find the container with id bb80f6f0a88004a6ca118449806acbc86a6a3fa456b4058d33d5f044f818086e
May 28 18:35:54.633941 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:54.633886    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" event={"ID":"b093d082-0972-4c82-a636-34a1d70509c1","Type":"ContainerStarted","Data":"bb80f6f0a88004a6ca118449806acbc86a6a3fa456b4058d33d5f044f818086e"}
May 28 18:35:57.645348 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:57.645310    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" event={"ID":"b093d082-0972-4c82-a636-34a1d70509c1","Type":"ContainerStarted","Data":"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"}
May 28 18:35:57.645746 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:57.645565    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:35:57.660194 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:35:57.660149    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" podStartSLOduration=1.693541947 podStartE2EDuration="4.66013481s" podCreationTimestamp="2026-05-28 18:35:53 +0000 UTC" firstStartedPulling="2026-05-28 18:35:53.769044658 +0000 UTC m=+592.469521628" lastFinishedPulling="2026-05-28 18:35:56.735637507 +0000 UTC m=+595.436114491" observedRunningTime="2026-05-28 18:35:57.659683367 +0000 UTC m=+596.360160360" watchObservedRunningTime="2026-05-28 18:35:57.66013481 +0000 UTC m=+596.360611796"
May 28 18:36:08.648861 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:08.648827    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:36:08.699821 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:08.699770    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:36:08.700162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:08.700103    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" podUID="b093d082-0972-4c82-a636-34a1d70509c1" containerName="limitador" containerID="cri-o://45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5" gracePeriod=30
May 28 18:36:09.235647 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.235629    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:36:09.319529 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.319444    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w24lf\" (UniqueName: \"kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf\") pod \"b093d082-0972-4c82-a636-34a1d70509c1\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") "
May 28 18:36:09.319529 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.319484    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file\") pod \"b093d082-0972-4c82-a636-34a1d70509c1\" (UID: \"b093d082-0972-4c82-a636-34a1d70509c1\") "
May 28 18:36:09.319892 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.319861    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file" (OuterVolumeSpecName: "config-file") pod "b093d082-0972-4c82-a636-34a1d70509c1" (UID: "b093d082-0972-4c82-a636-34a1d70509c1"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:36:09.321542 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.321521    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf" (OuterVolumeSpecName: "kube-api-access-w24lf") pod "b093d082-0972-4c82-a636-34a1d70509c1" (UID: "b093d082-0972-4c82-a636-34a1d70509c1"). InnerVolumeSpecName "kube-api-access-w24lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:09.419962 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.419923    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w24lf\" (UniqueName: \"kubernetes.io/projected/b093d082-0972-4c82-a636-34a1d70509c1-kube-api-access-w24lf\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:36:09.419962 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.419968    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b093d082-0972-4c82-a636-34a1d70509c1-config-file\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:36:09.683552 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.683519    2574 generic.go:358] "Generic (PLEG): container finished" podID="b093d082-0972-4c82-a636-34a1d70509c1" containerID="45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5" exitCode=0
May 28 18:36:09.684007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.683596    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" event={"ID":"b093d082-0972-4c82-a636-34a1d70509c1","Type":"ContainerDied","Data":"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"}
May 28 18:36:09.684007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.683607    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs"
May 28 18:36:09.684007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.683627    2574 scope.go:117] "RemoveContainer" containerID="45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"
May 28 18:36:09.684007 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.683617    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-z7ccs" event={"ID":"b093d082-0972-4c82-a636-34a1d70509c1","Type":"ContainerDied","Data":"bb80f6f0a88004a6ca118449806acbc86a6a3fa456b4058d33d5f044f818086e"}
May 28 18:36:09.690985 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.690967    2574 scope.go:117] "RemoveContainer" containerID="45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"
May 28 18:36:09.691266 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:36:09.691246    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5\": container with ID starting with 45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5 not found: ID does not exist" containerID="45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"
May 28 18:36:09.691326 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.691277    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5"} err="failed to get container status \"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5\": rpc error: code = NotFound desc = could not find container \"45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5\": container with ID starting with 45e35bb031f7540af01b5b520ba75f19fa8fdaaca379c004c7eb3997341363b5 not found: ID does not exist"
May 28 18:36:09.705997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.705972    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:36:09.709131 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.709111    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-z7ccs"]
May 28 18:36:09.874280 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:09.874250    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b093d082-0972-4c82-a636-34a1d70509c1" path="/var/lib/kubelet/pods/b093d082-0972-4c82-a636-34a1d70509c1/volumes"
May 28 18:36:10.240761 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.240722    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h2xrh"]
May 28 18:36:10.241026 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.241012    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b093d082-0972-4c82-a636-34a1d70509c1" containerName="limitador"
May 28 18:36:10.241083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.241027    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b093d082-0972-4c82-a636-34a1d70509c1" containerName="limitador"
May 28 18:36:10.241083 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.241077    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="b093d082-0972-4c82-a636-34a1d70509c1" containerName="limitador"
May 28 18:36:10.243715 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.243686    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.245994 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.245973    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 28 18:36:10.245994 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.245982    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8d5f4\""
May 28 18:36:10.254235 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.254212    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h2xrh"]
May 28 18:36:10.326550 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.326507    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p2s9\" (UniqueName: \"kubernetes.io/projected/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-kube-api-access-7p2s9\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.326724 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.326577    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-data\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.427275 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.427240    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-data\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.427467 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.427310    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7p2s9\" (UniqueName: \"kubernetes.io/projected/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-kube-api-access-7p2s9\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.427625 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.427602    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-data\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.435476 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.435449    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p2s9\" (UniqueName: \"kubernetes.io/projected/4b6d2e5e-7138-48f7-b7e6-b35e2232c54f-kube-api-access-7p2s9\") pod \"postgres-68c4fbbd6f-h2xrh\" (UID: \"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f\") " pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.555674 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.555583    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:10.676934 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.676910    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-h2xrh"]
May 28 18:36:10.679669 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:36:10.679642    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6d2e5e_7138_48f7_b7e6_b35e2232c54f.slice/crio-c7132a1427528903e777e1a110bbdaa9c93b53204e93e42bc3a9b18d8373edeb WatchSource:0}: Error finding container c7132a1427528903e777e1a110bbdaa9c93b53204e93e42bc3a9b18d8373edeb: Status 404 returned error can't find the container with id c7132a1427528903e777e1a110bbdaa9c93b53204e93e42bc3a9b18d8373edeb
May 28 18:36:10.689202 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:10.689176    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-h2xrh" event={"ID":"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f","Type":"ContainerStarted","Data":"c7132a1427528903e777e1a110bbdaa9c93b53204e93e42bc3a9b18d8373edeb"}
May 28 18:36:16.710162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:16.710126    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-h2xrh" event={"ID":"4b6d2e5e-7138-48f7-b7e6-b35e2232c54f","Type":"ContainerStarted","Data":"a61e731346b0695c0c5fc3e486abce3b71b45a34a6b0a3195c96f41d2dbda87f"}
May 28 18:36:16.710518 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:16.710262    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:16.725386 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:16.725337    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-h2xrh" podStartSLOduration=1.6206997539999999 podStartE2EDuration="6.725324587s" podCreationTimestamp="2026-05-28 18:36:10 +0000 UTC" firstStartedPulling="2026-05-28 18:36:10.68128878 +0000 UTC m=+609.381765750" lastFinishedPulling="2026-05-28 18:36:15.785913606 +0000 UTC m=+614.486390583" observedRunningTime="2026-05-28 18:36:16.724024158 +0000 UTC m=+615.424501149" watchObservedRunningTime="2026-05-28 18:36:16.725324587 +0000 UTC m=+615.425801634"
May 28 18:36:22.742347 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:22.742318    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-h2xrh"
May 28 18:36:28.327214 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.327182    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:28.346912 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.346883    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:28.347081 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.347021    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:28.349866 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.349842    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-djfgm\""
May 28 18:36:28.350041 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.350022    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 18:36:28.451601 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.451563    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsr72\" (UniqueName: \"kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72\") pod \"maas-controller-847545b68-2ssw6\" (UID: \"70154a7b-f9b5-4083-8e60-24a319e86099\") " pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:28.480095 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.480065    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:36:28.483437 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.483415    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:28.490891 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.490870    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:36:28.552785 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.552749    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsr72\" (UniqueName: \"kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72\") pod \"maas-controller-847545b68-2ssw6\" (UID: \"70154a7b-f9b5-4083-8e60-24a319e86099\") " pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:28.552960 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.552845    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzrds\" (UniqueName: \"kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds\") pod \"maas-controller-7dd9d4fb58-nx9xt\" (UID: \"f22a3940-942d-42fc-a360-a7a0068fae89\") " pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:28.561018 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.560996    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsr72\" (UniqueName: \"kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72\") pod \"maas-controller-847545b68-2ssw6\" (UID: \"70154a7b-f9b5-4083-8e60-24a319e86099\") " pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:28.654168 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.654138    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzrds\" (UniqueName: \"kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds\") pod \"maas-controller-7dd9d4fb58-nx9xt\" (UID: \"f22a3940-942d-42fc-a360-a7a0068fae89\") " pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:28.657075 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.657055    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:28.661624 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.661598    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzrds\" (UniqueName: \"kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds\") pod \"maas-controller-7dd9d4fb58-nx9xt\" (UID: \"f22a3940-942d-42fc-a360-a7a0068fae89\") " pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:28.776881 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.776850    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:28.779739 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:36:28.779709    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70154a7b_f9b5_4083_8e60_24a319e86099.slice/crio-f961ab699e390250df20d2776bea3a0f826a78fcfc3bcf47687530f6a10b5843 WatchSource:0}: Error finding container f961ab699e390250df20d2776bea3a0f826a78fcfc3bcf47687530f6a10b5843: Status 404 returned error can't find the container with id f961ab699e390250df20d2776bea3a0f826a78fcfc3bcf47687530f6a10b5843
May 28 18:36:28.794480 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.794458    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:28.915511 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:28.915420    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:36:28.918955 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:36:28.918906    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22a3940_942d_42fc_a360_a7a0068fae89.slice/crio-1772799275dac873990474b2de7fca442197f78e467db09142c5f365f3882f52 WatchSource:0}: Error finding container 1772799275dac873990474b2de7fca442197f78e467db09142c5f365f3882f52: Status 404 returned error can't find the container with id 1772799275dac873990474b2de7fca442197f78e467db09142c5f365f3882f52
May 28 18:36:29.757395 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:29.757358    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847545b68-2ssw6" event={"ID":"70154a7b-f9b5-4083-8e60-24a319e86099","Type":"ContainerStarted","Data":"f961ab699e390250df20d2776bea3a0f826a78fcfc3bcf47687530f6a10b5843"}
May 28 18:36:29.759340 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:29.759151    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" event={"ID":"f22a3940-942d-42fc-a360-a7a0068fae89","Type":"ContainerStarted","Data":"1772799275dac873990474b2de7fca442197f78e467db09142c5f365f3882f52"}
May 28 18:36:31.774023 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.773914    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" event={"ID":"f22a3940-942d-42fc-a360-a7a0068fae89","Type":"ContainerStarted","Data":"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"}
May 28 18:36:31.774023 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.774002    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:31.775448 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.775419    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847545b68-2ssw6" event={"ID":"70154a7b-f9b5-4083-8e60-24a319e86099","Type":"ContainerStarted","Data":"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"}
May 28 18:36:31.775582 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.775565    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:31.827854 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.827808    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-847545b68-2ssw6" podStartSLOduration=1.2391143119999999 podStartE2EDuration="3.827779644s" podCreationTimestamp="2026-05-28 18:36:28 +0000 UTC" firstStartedPulling="2026-05-28 18:36:28.781031403 +0000 UTC m=+627.481508373" lastFinishedPulling="2026-05-28 18:36:31.369696733 +0000 UTC m=+630.070173705" observedRunningTime="2026-05-28 18:36:31.827054138 +0000 UTC m=+630.527531130" watchObservedRunningTime="2026-05-28 18:36:31.827779644 +0000 UTC m=+630.528256636"
May 28 18:36:31.828000 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:31.827886    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" podStartSLOduration=1.372306982 podStartE2EDuration="3.82788191s" podCreationTimestamp="2026-05-28 18:36:28 +0000 UTC" firstStartedPulling="2026-05-28 18:36:28.920899447 +0000 UTC m=+627.621376417" lastFinishedPulling="2026-05-28 18:36:31.376474364 +0000 UTC m=+630.076951345" observedRunningTime="2026-05-28 18:36:31.807240197 +0000 UTC m=+630.507717200" watchObservedRunningTime="2026-05-28 18:36:31.82788191 +0000 UTC m=+630.528358910"
May 28 18:36:42.784267 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:42.784236    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:36:42.786545 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:42.784286    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:42.834002 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:42.833970    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:42.834194 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:42.834174    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-847545b68-2ssw6" podUID="70154a7b-f9b5-4083-8e60-24a319e86099" containerName="manager" containerID="cri-o://89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2" gracePeriod=30
May 28 18:36:43.074052 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.074031    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:43.167534 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.167504    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsr72\" (UniqueName: \"kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72\") pod \"70154a7b-f9b5-4083-8e60-24a319e86099\" (UID: \"70154a7b-f9b5-4083-8e60-24a319e86099\") "
May 28 18:36:43.169593 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.169567    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72" (OuterVolumeSpecName: "kube-api-access-bsr72") pod "70154a7b-f9b5-4083-8e60-24a319e86099" (UID: "70154a7b-f9b5-4083-8e60-24a319e86099"). InnerVolumeSpecName "kube-api-access-bsr72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:43.272419 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.268283    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsr72\" (UniqueName: \"kubernetes.io/projected/70154a7b-f9b5-4083-8e60-24a319e86099-kube-api-access-bsr72\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:36:43.816886 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.816844    2574 generic.go:358] "Generic (PLEG): container finished" podID="70154a7b-f9b5-4083-8e60-24a319e86099" containerID="89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2" exitCode=0
May 28 18:36:43.817247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.816929    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847545b68-2ssw6" event={"ID":"70154a7b-f9b5-4083-8e60-24a319e86099","Type":"ContainerDied","Data":"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"}
May 28 18:36:43.817247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.816937    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-847545b68-2ssw6"
May 28 18:36:43.817247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.816979    2574 scope.go:117] "RemoveContainer" containerID="89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"
May 28 18:36:43.817247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.816968    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-847545b68-2ssw6" event={"ID":"70154a7b-f9b5-4083-8e60-24a319e86099","Type":"ContainerDied","Data":"f961ab699e390250df20d2776bea3a0f826a78fcfc3bcf47687530f6a10b5843"}
May 28 18:36:43.824431 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.824416    2574 scope.go:117] "RemoveContainer" containerID="89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"
May 28 18:36:43.824673 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:36:43.824649    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2\": container with ID starting with 89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2 not found: ID does not exist" containerID="89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"
May 28 18:36:43.824769 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.824678    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2"} err="failed to get container status \"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2\": rpc error: code = NotFound desc = could not find container \"89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2\": container with ID starting with 89e230e2f9566174c832f98675aaf2f9bf44610713539f7d7265e08fcf6bb4b2 not found: ID does not exist"
May 28 18:36:43.836260 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.836236    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:43.841421 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.841400    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-847545b68-2ssw6"]
May 28 18:36:43.873706 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:36:43.873685    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70154a7b-f9b5-4083-8e60-24a319e86099" path="/var/lib/kubelet/pods/70154a7b-f9b5-4083-8e60-24a319e86099/volumes"
May 28 18:37:02.644199 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.644166    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-589f656766-65j8r"]
May 28 18:37:02.644578 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.644480    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70154a7b-f9b5-4083-8e60-24a319e86099" containerName="manager"
May 28 18:37:02.644578 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.644491    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="70154a7b-f9b5-4083-8e60-24a319e86099" containerName="manager"
May 28 18:37:02.644578 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.644542    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="70154a7b-f9b5-4083-8e60-24a319e86099" containerName="manager"
May 28 18:37:02.648781 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.648760    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:02.652201 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.652169    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cmclm\""
May 28 18:37:02.652325 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.652257    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 18:37:02.657855 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.657820    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-589f656766-65j8r"]
May 28 18:37:02.720538 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.720501    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pzm5\" (UniqueName: \"kubernetes.io/projected/5f5bf1ef-325e-4cc1-931e-96140deadc33-kube-api-access-8pzm5\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:02.720538 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.720542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:02.821125 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.821086    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pzm5\" (UniqueName: \"kubernetes.io/projected/5f5bf1ef-325e-4cc1-931e-96140deadc33-kube-api-access-8pzm5\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:02.821125 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.821129    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:02.821325 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:37:02.821259    2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 28 18:37:02.821378 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:37:02.821366    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls podName:5f5bf1ef-325e-4cc1-931e-96140deadc33 nodeName:}" failed. No retries permitted until 2026-05-28 18:37:03.321343046 +0000 UTC m=+662.021820016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls") pod "maas-api-589f656766-65j8r" (UID: "5f5bf1ef-325e-4cc1-931e-96140deadc33") : secret "maas-api-serving-cert" not found
May 28 18:37:02.833443 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:02.833410    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pzm5\" (UniqueName: \"kubernetes.io/projected/5f5bf1ef-325e-4cc1-931e-96140deadc33-kube-api-access-8pzm5\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:03.014328 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.014246    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"]
May 28 18:37:03.017239 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.017222    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:03.019472 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.019446    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5tbg2\""
May 28 18:37:03.019606 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.019588    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
May 28 18:37:03.026308 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.026286    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"]
May 28 18:37:03.123773 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.123740    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbzj\" (UniqueName: \"kubernetes.io/projected/4e8bec75-6151-432d-b513-48048be21744-kube-api-access-ffbzj\") pod \"payload-processing-58b6c8fdc7-5xjh8\" (UID: \"4e8bec75-6151-432d-b513-48048be21744\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:03.225002 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.224967    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbzj\" (UniqueName: \"kubernetes.io/projected/4e8bec75-6151-432d-b513-48048be21744-kube-api-access-ffbzj\") pod \"payload-processing-58b6c8fdc7-5xjh8\" (UID: \"4e8bec75-6151-432d-b513-48048be21744\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:03.232850 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.232825    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbzj\" (UniqueName: \"kubernetes.io/projected/4e8bec75-6151-432d-b513-48048be21744-kube-api-access-ffbzj\") pod \"payload-processing-58b6c8fdc7-5xjh8\" (UID: \"4e8bec75-6151-432d-b513-48048be21744\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:03.326400 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.326312    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:03.328358 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.328335    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:03.328738 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.328705    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5bf1ef-325e-4cc1-931e-96140deadc33-maas-api-tls\") pod \"maas-api-589f656766-65j8r\" (UID: \"5f5bf1ef-325e-4cc1-931e-96140deadc33\") " pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:03.454569 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.454541    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"]
May 28 18:37:03.457239 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:37:03.457207    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8bec75_6151_432d_b513_48048be21744.slice/crio-987f0f4a50076ebb0725c2e61f91c5c924c014e8a5c5315a1e9d67c7fa2b2aa5 WatchSource:0}: Error finding container 987f0f4a50076ebb0725c2e61f91c5c924c014e8a5c5315a1e9d67c7fa2b2aa5: Status 404 returned error can't find the container with id 987f0f4a50076ebb0725c2e61f91c5c924c014e8a5c5315a1e9d67c7fa2b2aa5
May 28 18:37:03.558847 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.558814    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:03.677977 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.677947    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-589f656766-65j8r"]
May 28 18:37:03.680757 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:37:03.680733    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5bf1ef_325e_4cc1_931e_96140deadc33.slice/crio-dbe12e45ca8fe294cf85c791be082edae88414f0a4ab24315d6ee6f9b52f72c3 WatchSource:0}: Error finding container dbe12e45ca8fe294cf85c791be082edae88414f0a4ab24315d6ee6f9b52f72c3: Status 404 returned error can't find the container with id dbe12e45ca8fe294cf85c791be082edae88414f0a4ab24315d6ee6f9b52f72c3
May 28 18:37:03.877997 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.877966    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-589f656766-65j8r" event={"ID":"5f5bf1ef-325e-4cc1-931e-96140deadc33","Type":"ContainerStarted","Data":"dbe12e45ca8fe294cf85c791be082edae88414f0a4ab24315d6ee6f9b52f72c3"}
May 28 18:37:03.878943 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:03.878915    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8" event={"ID":"4e8bec75-6151-432d-b513-48048be21744","Type":"ContainerStarted","Data":"987f0f4a50076ebb0725c2e61f91c5c924c014e8a5c5315a1e9d67c7fa2b2aa5"}
May 28 18:37:05.887275 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.887232    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-589f656766-65j8r" event={"ID":"5f5bf1ef-325e-4cc1-931e-96140deadc33","Type":"ContainerStarted","Data":"f3aea9156107489d70c22143a7c849c9f714c9fdf88aa367c201a868243f28d7"}
May 28 18:37:05.887729 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.887478    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:05.888582 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.888551    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8" event={"ID":"4e8bec75-6151-432d-b513-48048be21744","Type":"ContainerStarted","Data":"162bfa62ad69b1e5f5233f2983aef765878462ac05b46009780b9bee76a342c5"}
May 28 18:37:05.888683 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.888664    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:05.902454 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.902398    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-589f656766-65j8r" podStartSLOduration=2.121200687 podStartE2EDuration="3.902384082s" podCreationTimestamp="2026-05-28 18:37:02 +0000 UTC" firstStartedPulling="2026-05-28 18:37:03.682090723 +0000 UTC m=+662.382567693" lastFinishedPulling="2026-05-28 18:37:05.463274115 +0000 UTC m=+664.163751088" observedRunningTime="2026-05-28 18:37:05.90183421 +0000 UTC m=+664.602311199" watchObservedRunningTime="2026-05-28 18:37:05.902384082 +0000 UTC m=+664.602861077"
May 28 18:37:05.918664 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:05.918621    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8" podStartSLOduration=2.402951386 podStartE2EDuration="3.91860947s" podCreationTimestamp="2026-05-28 18:37:02 +0000 UTC" firstStartedPulling="2026-05-28 18:37:03.458997479 +0000 UTC m=+662.159474449" lastFinishedPulling="2026-05-28 18:37:04.974655558 +0000 UTC m=+663.675132533" observedRunningTime="2026-05-28 18:37:05.917954499 +0000 UTC m=+664.618431503" watchObservedRunningTime="2026-05-28 18:37:05.91860947 +0000 UTC m=+664.619086462"
May 28 18:37:11.898282 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:11.898250    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-589f656766-65j8r"
May 28 18:37:16.895525 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:16.895492    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-5xjh8"
May 28 18:37:19.874614 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.874583    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"]
May 28 18:37:19.877508 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.877493    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.880758 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.880734    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 18:37:19.880897 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.880734    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 18:37:19.880944 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.880896    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vdddg\""
May 28 18:37:19.880998 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.880983    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 18:37:19.886461 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.886433    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"]
May 28 18:37:19.970153 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970122    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.970294 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.970294 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970205    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42sgz\" (UniqueName: \"kubernetes.io/projected/958fff60-9c99-47d1-b04b-36f85d63554d-kube-api-access-42sgz\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.970294 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.970396 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:19.970429 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:19.970391    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958fff60-9c99-47d1-b04b-36f85d63554d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071507 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071470    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071507 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071510    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071709 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071635    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42sgz\" (UniqueName: \"kubernetes.io/projected/958fff60-9c99-47d1-b04b-36f85d63554d-kube-api-access-42sgz\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071709 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071675    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071709 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071697    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071906 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071721    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958fff60-9c99-47d1-b04b-36f85d63554d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.071962 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.071917    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.072050 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.072029    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.072109 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.072072    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.073869 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.073838    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/958fff60-9c99-47d1-b04b-36f85d63554d-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.074164 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.074146    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/958fff60-9c99-47d1-b04b-36f85d63554d-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.078705 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.078681    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42sgz\" (UniqueName: \"kubernetes.io/projected/958fff60-9c99-47d1-b04b-36f85d63554d-kube-api-access-42sgz\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn\" (UID: \"958fff60-9c99-47d1-b04b-36f85d63554d\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.188302 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.188214    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:20.320974 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.320937    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"]
May 28 18:37:20.323742 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:37:20.323705    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod958fff60_9c99_47d1_b04b_36f85d63554d.slice/crio-1977fd12316ecb4b34b94f6e5664aa04090dae804f3c46abade338ca15072c0a WatchSource:0}: Error finding container 1977fd12316ecb4b34b94f6e5664aa04090dae804f3c46abade338ca15072c0a: Status 404 returned error can't find the container with id 1977fd12316ecb4b34b94f6e5664aa04090dae804f3c46abade338ca15072c0a
May 28 18:37:20.940992 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:20.940936    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn" event={"ID":"958fff60-9c99-47d1-b04b-36f85d63554d","Type":"ContainerStarted","Data":"1977fd12316ecb4b34b94f6e5664aa04090dae804f3c46abade338ca15072c0a"}
May 28 18:37:27.965708 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:27.965675    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn" event={"ID":"958fff60-9c99-47d1-b04b-36f85d63554d","Type":"ContainerStarted","Data":"fb19f4d31da8dc3e9943b244e4571660038206eedcf4ed37170e39d03a635f01"}
May 28 18:37:32.984166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:32.984130    2574 generic.go:358] "Generic (PLEG): container finished" podID="958fff60-9c99-47d1-b04b-36f85d63554d" containerID="fb19f4d31da8dc3e9943b244e4571660038206eedcf4ed37170e39d03a635f01" exitCode=0
May 28 18:37:32.984619 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:32.984213    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn" event={"ID":"958fff60-9c99-47d1-b04b-36f85d63554d","Type":"ContainerDied","Data":"fb19f4d31da8dc3e9943b244e4571660038206eedcf4ed37170e39d03a635f01"}
May 28 18:37:32.984946 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:32.984927    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:37:34.993562 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:34.993533    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn" event={"ID":"958fff60-9c99-47d1-b04b-36f85d63554d","Type":"ContainerStarted","Data":"1ae6a6c79bf55cffd0f6ee89dd10d735a93bf5e3d74e68368949673304e3e993"}
May 28 18:37:34.993964 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:34.993743    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:35.012678 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:35.012634    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn" podStartSLOduration=2.211180505 podStartE2EDuration="16.012619571s" podCreationTimestamp="2026-05-28 18:37:19 +0000 UTC" firstStartedPulling="2026-05-28 18:37:20.325546311 +0000 UTC m=+679.026023281" lastFinishedPulling="2026-05-28 18:37:34.126985373 +0000 UTC m=+692.827462347" observedRunningTime="2026-05-28 18:37:35.011056742 +0000 UTC m=+693.711533735" watchObservedRunningTime="2026-05-28 18:37:35.012619571 +0000 UTC m=+693.713096562"
May 28 18:37:37.369963 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.369925    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"]
May 28 18:37:37.376520 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.376498    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.379460 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.379441    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 18:37:37.384847 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.384822    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"]
May 28 18:37:37.419954 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.419925    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.420070 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.419960    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.420070 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.419992    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.420070 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.420050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v65dh\" (UniqueName: \"kubernetes.io/projected/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kube-api-access-v65dh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.420179 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.420092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.420179 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.420124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.520839 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.520810    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.520848    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.520890    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.520914    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v65dh\" (UniqueName: \"kubernetes.io/projected/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kube-api-access-v65dh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521003 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.520951    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521208 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.521162    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521361 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.521336    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521419 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.521371    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.521419 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.521403    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.523226 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.523198    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.523341 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.523293    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.528423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.528401    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v65dh\" (UniqueName: \"kubernetes.io/projected/501ba88b-1f09-4a58-90f9-b3d6ac61c24c-kube-api-access-v65dh\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw\" (UID: \"501ba88b-1f09-4a58-90f9-b3d6ac61c24c\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.686901 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.686821    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:37.827112 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:37.827088    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"]
May 28 18:37:37.829050 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:37:37.829019    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501ba88b_1f09_4a58_90f9_b3d6ac61c24c.slice/crio-58ce860840d952e8796da0b88b48820a0465bb9d218359bdf5a9b1b49c767ea9 WatchSource:0}: Error finding container 58ce860840d952e8796da0b88b48820a0465bb9d218359bdf5a9b1b49c767ea9: Status 404 returned error can't find the container with id 58ce860840d952e8796da0b88b48820a0465bb9d218359bdf5a9b1b49c767ea9
May 28 18:37:38.009840 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:38.009730    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw" event={"ID":"501ba88b-1f09-4a58-90f9-b3d6ac61c24c","Type":"ContainerStarted","Data":"617a51946d778fff100d4f5825ee8bff1298f68ea3d6e60ccc047b89f067c520"}
May 28 18:37:38.009840 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:38.009768    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw" event={"ID":"501ba88b-1f09-4a58-90f9-b3d6ac61c24c","Type":"ContainerStarted","Data":"58ce860840d952e8796da0b88b48820a0465bb9d218359bdf5a9b1b49c767ea9"}
May 28 18:37:46.016210 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:46.016132    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn"
May 28 18:37:47.044144 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:47.044111    2574 generic.go:358] "Generic (PLEG): container finished" podID="501ba88b-1f09-4a58-90f9-b3d6ac61c24c" containerID="617a51946d778fff100d4f5825ee8bff1298f68ea3d6e60ccc047b89f067c520" exitCode=0
May 28 18:37:47.044520 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:47.044185    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw" event={"ID":"501ba88b-1f09-4a58-90f9-b3d6ac61c24c","Type":"ContainerDied","Data":"617a51946d778fff100d4f5825ee8bff1298f68ea3d6e60ccc047b89f067c520"}
May 28 18:37:48.048932 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.048895    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw" event={"ID":"501ba88b-1f09-4a58-90f9-b3d6ac61c24c","Type":"ContainerStarted","Data":"d4810dd48a953ff269513c3e2ce98f60742541eff95c8742078a462265328705"}
May 28 18:37:48.049321 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.049118    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:37:48.067968 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.067923    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw" podStartSLOduration=10.843797004 podStartE2EDuration="11.067909063s" podCreationTimestamp="2026-05-28 18:37:37 +0000 UTC" firstStartedPulling="2026-05-28 18:37:47.044758021 +0000 UTC m=+705.745234991" lastFinishedPulling="2026-05-28 18:37:47.268870073 +0000 UTC m=+705.969347050" observedRunningTime="2026-05-28 18:37:48.066147835 +0000 UTC m=+706.766624833" watchObservedRunningTime="2026-05-28 18:37:48.067909063 +0000 UTC m=+706.768386064"
May 28 18:37:48.970821 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.970769    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"]
May 28 18:37:48.974196 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.974175    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:48.976579 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.976557    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 28 18:37:48.982355 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:48.982332    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"]
May 28 18:37:49.127507 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f05fdb-e554-454c-942f-33d804d6ff56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.127878 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127519    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.127878 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127574    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.127878 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127626    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-584d9\" (UniqueName: \"kubernetes.io/projected/08f05fdb-e554-454c-942f-33d804d6ff56-kube-api-access-584d9\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.127878 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127677    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.127878 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.127731    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229092 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229013    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229092 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229056    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229092 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229085    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-584d9\" (UniqueName: \"kubernetes.io/projected/08f05fdb-e554-454c-942f-33d804d6ff56-kube-api-access-584d9\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229312 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229115    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229312 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229134    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229312 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229187    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f05fdb-e554-454c-942f-33d804d6ff56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229507 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229486    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229560 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229521    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.229605 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.229570    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.231518 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.231494    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/08f05fdb-e554-454c-942f-33d804d6ff56-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.231636 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.231622    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/08f05fdb-e554-454c-942f-33d804d6ff56-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.237400 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.237349    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-584d9\" (UniqueName: \"kubernetes.io/projected/08f05fdb-e554-454c-942f-33d804d6ff56-kube-api-access-584d9\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4\" (UID: \"08f05fdb-e554-454c-942f-33d804d6ff56\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.285049 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.285019    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:49.411608 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:49.411567    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"]
May 28 18:37:49.413552 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:37:49.413526    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f05fdb_e554_454c_942f_33d804d6ff56.slice/crio-62211823bf3698296fe90e48e4c023e9559f4d1c7612dfcf3429d04bbf01d3d8 WatchSource:0}: Error finding container 62211823bf3698296fe90e48e4c023e9559f4d1c7612dfcf3429d04bbf01d3d8: Status 404 returned error can't find the container with id 62211823bf3698296fe90e48e4c023e9559f4d1c7612dfcf3429d04bbf01d3d8
May 28 18:37:50.057665 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:50.057624    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4" event={"ID":"08f05fdb-e554-454c-942f-33d804d6ff56","Type":"ContainerStarted","Data":"b5a4e4a1d3c10345f5adf7483b249fd81846669a4900a270e50938b2c6720717"}
May 28 18:37:50.057837 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:50.057669    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4" event={"ID":"08f05fdb-e554-454c-942f-33d804d6ff56","Type":"ContainerStarted","Data":"62211823bf3698296fe90e48e4c023e9559f4d1c7612dfcf3429d04bbf01d3d8"}
May 28 18:37:55.076200 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:55.076160    2574 generic.go:358] "Generic (PLEG): container finished" podID="08f05fdb-e554-454c-942f-33d804d6ff56" containerID="b5a4e4a1d3c10345f5adf7483b249fd81846669a4900a270e50938b2c6720717" exitCode=0
May 28 18:37:55.076530 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:55.076235    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4" event={"ID":"08f05fdb-e554-454c-942f-33d804d6ff56","Type":"ContainerDied","Data":"b5a4e4a1d3c10345f5adf7483b249fd81846669a4900a270e50938b2c6720717"}
May 28 18:37:56.083552 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:56.083512    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4" event={"ID":"08f05fdb-e554-454c-942f-33d804d6ff56","Type":"ContainerStarted","Data":"7f143a792636ded601b60473a24d3fa170d7b9985f7de96f47cc7828403a1fc6"}
May 28 18:37:56.083946 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:56.083727    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:37:56.101856 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:56.101781    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4" podStartSLOduration=7.6699853430000005 podStartE2EDuration="8.101763751s" podCreationTimestamp="2026-05-28 18:37:48 +0000 UTC" firstStartedPulling="2026-05-28 18:37:55.076860515 +0000 UTC m=+713.777337488" lastFinishedPulling="2026-05-28 18:37:55.50863891 +0000 UTC m=+714.209115896" observedRunningTime="2026-05-28 18:37:56.100951748 +0000 UTC m=+714.801428754" watchObservedRunningTime="2026-05-28 18:37:56.101763751 +0000 UTC m=+714.802240744"
May 28 18:37:59.066590 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:37:59.066557    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw"
May 28 18:38:07.099568 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:07.099537    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4"
May 28 18:38:09.288366 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.288336    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"]
May 28 18:38:09.310162 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.310136    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"]
May 28 18:38:09.310314 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.310248    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.312808 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.312764    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 28 18:38:09.507051 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.507051 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507056    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.507251 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.507251 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507129    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.507251 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507215    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.507251 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.507243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsq6w\" (UniqueName: \"kubernetes.io/projected/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kube-api-access-nsq6w\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.607747 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607645    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.607747 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607698    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsq6w\" (UniqueName: \"kubernetes.io/projected/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kube-api-access-nsq6w\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.607747 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607732    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608058 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607765    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608058 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607804    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608058 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.607836    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608261 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.608174    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608261 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.608191    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.608261 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.608210    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.610135 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.610104    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.610354 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.610336    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.615210 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.615187    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsq6w\" (UniqueName: \"kubernetes.io/projected/280f632b-36bf-46a9-b7a1-1d4ceb84cea8-kube-api-access-nsq6w\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-n64g7\" (UID: \"280f632b-36bf-46a9-b7a1-1d4ceb84cea8\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.621063 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.621044    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:09.763690 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:09.763662    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"]
May 28 18:38:09.766870 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:38:09.766840    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280f632b_36bf_46a9_b7a1_1d4ceb84cea8.slice/crio-04729c019fff6bf57fe7de562ba4b074fcfc2e8648866cc3eda11dfb922c5dc1 WatchSource:0}: Error finding container 04729c019fff6bf57fe7de562ba4b074fcfc2e8648866cc3eda11dfb922c5dc1: Status 404 returned error can't find the container with id 04729c019fff6bf57fe7de562ba4b074fcfc2e8648866cc3eda11dfb922c5dc1
May 28 18:38:10.136077 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:10.136032    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7" event={"ID":"280f632b-36bf-46a9-b7a1-1d4ceb84cea8","Type":"ContainerStarted","Data":"d73e9ce72f4bdd1a90c11bf3485d31453ebb16b1d3035d09a1f08b548bf097b8"}
May 28 18:38:10.136077 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:10.136082    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7" event={"ID":"280f632b-36bf-46a9-b7a1-1d4ceb84cea8","Type":"ContainerStarted","Data":"04729c019fff6bf57fe7de562ba4b074fcfc2e8648866cc3eda11dfb922c5dc1"}
May 28 18:38:16.156673 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:16.156637    2574 generic.go:358] "Generic (PLEG): container finished" podID="280f632b-36bf-46a9-b7a1-1d4ceb84cea8" containerID="d73e9ce72f4bdd1a90c11bf3485d31453ebb16b1d3035d09a1f08b548bf097b8" exitCode=0
May 28 18:38:16.157089 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:16.156708    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7" event={"ID":"280f632b-36bf-46a9-b7a1-1d4ceb84cea8","Type":"ContainerDied","Data":"d73e9ce72f4bdd1a90c11bf3485d31453ebb16b1d3035d09a1f08b548bf097b8"}
May 28 18:38:17.162469 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:17.162432    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7" event={"ID":"280f632b-36bf-46a9-b7a1-1d4ceb84cea8","Type":"ContainerStarted","Data":"e83d376f335ed7e195f19da516ca17fc5fe7fe20db1c1bba6b4675e353e3e8b3"}
May 28 18:38:17.162895 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:17.162649    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:17.180809 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:17.180745    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7" podStartSLOduration=7.878504231 podStartE2EDuration="8.180732291s" podCreationTimestamp="2026-05-28 18:38:09 +0000 UTC" firstStartedPulling="2026-05-28 18:38:16.157367374 +0000 UTC m=+734.857844344" lastFinishedPulling="2026-05-28 18:38:16.459595434 +0000 UTC m=+735.160072404" observedRunningTime="2026-05-28 18:38:17.178873675 +0000 UTC m=+735.879350670" watchObservedRunningTime="2026-05-28 18:38:17.180732291 +0000 UTC m=+735.881209286"
May 28 18:38:19.271106 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.271064    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"]
May 28 18:38:19.274108 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.274083    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.276292 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.276268    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 18:38:19.282052 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c441c15-3e60-4759-8b5e-f80b5a622019-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.282180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282082    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.282180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282116    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.282180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282163    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.282344 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsd65\" (UniqueName: \"kubernetes.io/projected/1c441c15-3e60-4759-8b5e-f80b5a622019-kube-api-access-zsd65\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.282344 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.282237    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.283225 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.283200    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"]
May 28 18:38:19.382971 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.382937    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c441c15-3e60-4759-8b5e-f80b5a622019-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.382984    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383011    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383045    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383068    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zsd65\" (UniqueName: \"kubernetes.io/projected/1c441c15-3e60-4759-8b5e-f80b5a622019-kube-api-access-zsd65\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383166 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383099    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383529 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383505    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383594 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383576    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.383637 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.383612    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.385335 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.385313    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c441c15-3e60-4759-8b5e-f80b5a622019-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.385485 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.385471    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c441c15-3e60-4759-8b5e-f80b5a622019-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.390141 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.390119    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsd65\" (UniqueName: \"kubernetes.io/projected/1c441c15-3e60-4759-8b5e-f80b5a622019-kube-api-access-zsd65\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt\" (UID: \"1c441c15-3e60-4759-8b5e-f80b5a622019\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.586704 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.586625    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:19.720423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:19.720397    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"]
May 28 18:38:19.722421 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:38:19.722391    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c441c15_3e60_4759_8b5e_f80b5a622019.slice/crio-5825c610ecac8600d5c5605f31db23a455bc5dfb2a8b4709e664641c596d1394 WatchSource:0}: Error finding container 5825c610ecac8600d5c5605f31db23a455bc5dfb2a8b4709e664641c596d1394: Status 404 returned error can't find the container with id 5825c610ecac8600d5c5605f31db23a455bc5dfb2a8b4709e664641c596d1394
May 28 18:38:20.174247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:20.174204    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt" event={"ID":"1c441c15-3e60-4759-8b5e-f80b5a622019","Type":"ContainerStarted","Data":"fdc69b26a46dc521b0d598467c89e2b7c7391395b9c0f4512352e643749cef3c"}
May 28 18:38:20.174247 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:20.174240    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt" event={"ID":"1c441c15-3e60-4759-8b5e-f80b5a622019","Type":"ContainerStarted","Data":"5825c610ecac8600d5c5605f31db23a455bc5dfb2a8b4709e664641c596d1394"}
May 28 18:38:25.192102 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:25.192067    2574 generic.go:358] "Generic (PLEG): container finished" podID="1c441c15-3e60-4759-8b5e-f80b5a622019" containerID="fdc69b26a46dc521b0d598467c89e2b7c7391395b9c0f4512352e643749cef3c" exitCode=0
May 28 18:38:25.192497 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:25.192122    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt" event={"ID":"1c441c15-3e60-4759-8b5e-f80b5a622019","Type":"ContainerDied","Data":"fdc69b26a46dc521b0d598467c89e2b7c7391395b9c0f4512352e643749cef3c"}
May 28 18:38:26.196412 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:26.196375    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt" event={"ID":"1c441c15-3e60-4759-8b5e-f80b5a622019","Type":"ContainerStarted","Data":"f77d45838c38c3be983f585ee048bf31ff6a11a2bdc4d0ccd55815de3a40ccc1"}
May 28 18:38:26.196826 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:26.196602    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:26.214895 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:26.214847    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt" podStartSLOduration=7.006957446 podStartE2EDuration="7.21483562s" podCreationTimestamp="2026-05-28 18:38:19 +0000 UTC" firstStartedPulling="2026-05-28 18:38:25.192722368 +0000 UTC m=+743.893199337" lastFinishedPulling="2026-05-28 18:38:25.400600522 +0000 UTC m=+744.101077511" observedRunningTime="2026-05-28 18:38:26.212300207 +0000 UTC m=+744.912777200" watchObservedRunningTime="2026-05-28 18:38:26.21483562 +0000 UTC m=+744.915312611"
May 28 18:38:28.178239 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:28.178200    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-n64g7"
May 28 18:38:37.212430 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:37.212391    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt"
May 28 18:38:41.983232 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:41.983197    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"]
May 28 18:38:41.987905 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:41.987881    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:41.990309 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:41.990287    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 18:38:41.995213 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:41.994969    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"]
May 28 18:38:42.069417 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htm96\" (UniqueName: \"kubernetes.io/projected/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kube-api-access-htm96\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.069584 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069424    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.069584 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069524    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.069675 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069637    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.069712 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069684    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.069746 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.069724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171101 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171063    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171286 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171124    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-htm96\" (UniqueName: \"kubernetes.io/projected/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kube-api-access-htm96\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171286 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171151    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171286 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171186    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171286 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171275    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171511 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171323    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171568 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171503    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171625 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171567    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.171739 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.171720    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.173314 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.173295    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.173605 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.173587    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.179173 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.179149    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htm96\" (UniqueName: \"kubernetes.io/projected/8ea0ac3e-706f-4347-8cc4-6a57b9487e3a-kube-api-access-htm96\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp\" (UID: \"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.298782 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.298698    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:42.439181 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:42.439150    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"]
May 28 18:38:42.440836 ip-10-0-139-21 kubenswrapper[2574]: W0528 18:38:42.440807    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea0ac3e_706f_4347_8cc4_6a57b9487e3a.slice/crio-541cb8dc3a1afb6e5f101e0c50f347dffdca1c4a14fede6f7b4d9c6b61b5cf07 WatchSource:0}: Error finding container 541cb8dc3a1afb6e5f101e0c50f347dffdca1c4a14fede6f7b4d9c6b61b5cf07: Status 404 returned error can't find the container with id 541cb8dc3a1afb6e5f101e0c50f347dffdca1c4a14fede6f7b4d9c6b61b5cf07
May 28 18:38:43.257692 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:43.257655    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp" event={"ID":"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a","Type":"ContainerStarted","Data":"20c9664744907cb9359c54b66905db43dba18ef177ad044bde15c3fb1df3abf1"}
May 28 18:38:43.258169 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:43.257702    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp" event={"ID":"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a","Type":"ContainerStarted","Data":"541cb8dc3a1afb6e5f101e0c50f347dffdca1c4a14fede6f7b4d9c6b61b5cf07"}
May 28 18:38:48.274722 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:48.274681    2574 generic.go:358] "Generic (PLEG): container finished" podID="8ea0ac3e-706f-4347-8cc4-6a57b9487e3a" containerID="20c9664744907cb9359c54b66905db43dba18ef177ad044bde15c3fb1df3abf1" exitCode=0
May 28 18:38:48.275089 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:48.274760    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp" event={"ID":"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a","Type":"ContainerDied","Data":"20c9664744907cb9359c54b66905db43dba18ef177ad044bde15c3fb1df3abf1"}
May 28 18:38:49.279758 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:49.279725    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp" event={"ID":"8ea0ac3e-706f-4347-8cc4-6a57b9487e3a","Type":"ContainerStarted","Data":"79183af6a644bdedd48fefe5426e57a9c8b47557a71d305cb506df8b39ea6741"}
May 28 18:38:49.280151 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:49.279947    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:38:49.300276 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:38:49.300223    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp" podStartSLOduration=8.07228991 podStartE2EDuration="8.300210129s" podCreationTimestamp="2026-05-28 18:38:41 +0000 UTC" firstStartedPulling="2026-05-28 18:38:48.275445173 +0000 UTC m=+766.975922146" lastFinishedPulling="2026-05-28 18:38:48.503365392 +0000 UTC m=+767.203842365" observedRunningTime="2026-05-28 18:38:49.299147535 +0000 UTC m=+767.999624527" watchObservedRunningTime="2026-05-28 18:38:49.300210129 +0000 UTC m=+768.000687121"
May 28 18:39:00.296255 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:39:00.296226    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp"
May 28 18:40:29.771544 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:29.771506    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:40:29.772062 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:29.771760    2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" podUID="f22a3940-942d-42fc-a360-a7a0068fae89" containerName="manager" containerID="cri-o://392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c" gracePeriod=30
May 28 18:40:30.017038 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.017014    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:40:30.129423 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.129388    2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzrds\" (UniqueName: \"kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds\") pod \"f22a3940-942d-42fc-a360-a7a0068fae89\" (UID: \"f22a3940-942d-42fc-a360-a7a0068fae89\") "
May 28 18:40:30.131463 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.131431    2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds" (OuterVolumeSpecName: "kube-api-access-gzrds") pod "f22a3940-942d-42fc-a360-a7a0068fae89" (UID: "f22a3940-942d-42fc-a360-a7a0068fae89"). InnerVolumeSpecName "kube-api-access-gzrds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:40:30.230769 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.230722    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzrds\" (UniqueName: \"kubernetes.io/projected/f22a3940-942d-42fc-a360-a7a0068fae89-kube-api-access-gzrds\") on node \"ip-10-0-139-21.ec2.internal\" DevicePath \"\""
May 28 18:40:30.633205 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.633171    2574 generic.go:358] "Generic (PLEG): container finished" podID="f22a3940-942d-42fc-a360-a7a0068fae89" containerID="392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c" exitCode=0
May 28 18:40:30.633509 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.633247    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" event={"ID":"f22a3940-942d-42fc-a360-a7a0068fae89","Type":"ContainerDied","Data":"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"}
May 28 18:40:30.633509 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.633256    2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt"
May 28 18:40:30.633509 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.633276    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7dd9d4fb58-nx9xt" event={"ID":"f22a3940-942d-42fc-a360-a7a0068fae89","Type":"ContainerDied","Data":"1772799275dac873990474b2de7fca442197f78e467db09142c5f365f3882f52"}
May 28 18:40:30.633509 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.633295    2574 scope.go:117] "RemoveContainer" containerID="392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"
May 28 18:40:30.641906 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.641888    2574 scope.go:117] "RemoveContainer" containerID="392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"
May 28 18:40:30.642140 ip-10-0-139-21 kubenswrapper[2574]: E0528 18:40:30.642110    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c\": container with ID starting with 392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c not found: ID does not exist" containerID="392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"
May 28 18:40:30.642180 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.642147    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c"} err="failed to get container status \"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c\": rpc error: code = NotFound desc = could not find container \"392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c\": container with ID starting with 392d49f3c9ca58f7815652f98b33caaa890e12478eb86bf1c8fe3c65bbb9133c not found: ID does not exist"
May 28 18:40:30.653279 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.653252    2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:40:30.657749 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:30.657727    2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7dd9d4fb58-nx9xt"]
May 28 18:40:31.874814 ip-10-0-139-21 kubenswrapper[2574]: I0528 18:40:31.874759    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f22a3940-942d-42fc-a360-a7a0068fae89" path="/var/lib/kubelet/pods/f22a3940-942d-42fc-a360-a7a0068fae89/volumes"
May 28 19:01:41.505692 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:41.505657    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5ljj6_4b647287-efd4-42ac-898b-c54b2b7d2968/manager/0.log"
May 28 19:01:41.625582 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:41.625552    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-589f656766-65j8r_5f5bf1ef-325e-4cc1-931e-96140deadc33/maas-api/0.log"
May 28 19:01:42.065706 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:42.065668    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xq4l5_b111eb3c-da72-4f75-b0f0-7c1bdfe656dc/manager/1.log"
May 28 19:01:42.292738 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:42.292695    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b658c4654-glz86_9cb96d74-b15c-4261-b1a8-422d9764ca06/manager/0.log"
May 28 19:01:42.527825 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:42.524309    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-h2xrh_4b6d2e5e-7138-48f7-b7e6-b35e2232c54f/postgres/0.log"
May 28 19:01:43.869525 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:43.869487    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ql2tr_72ece883-0670-4769-9625-e747624fef01/manager/0.log"
May 28 19:01:44.211297 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:44.211197    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2slqk_1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16/registry-server/0.log"
May 28 19:01:45.032428 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:45.032393    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vqvmc_0121e191-94ce-43b8-8c4c-e8703b197c8c/discovery/0.log"
May 28 19:01:45.143606 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:45.143528    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c6767894-4c52b_ef0d14fb-544d-44d4-a4a0-e37533aa224c/kube-auth-proxy/0.log"
May 28 19:01:45.497700 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:45.497670    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-5xjh8_4e8bec75-6151-432d-b513-48048be21744/payload-processing/0.log"
May 28 19:01:45.957848 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:45.957786    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt_1c441c15-3e60-4759-8b5e-f80b5a622019/main/0.log"
May 28 19:01:45.966405 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:45.966382    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-4zdnt_1c441c15-3e60-4759-8b5e-f80b5a622019/storage-initializer/0.log"
May 28 19:01:46.074124 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.074097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn_958fff60-9c99-47d1-b04b-36f85d63554d/storage-initializer/0.log"
May 28 19:01:46.082349 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.082319    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-f4nxn_958fff60-9c99-47d1-b04b-36f85d63554d/main/0.log"
May 28 19:01:46.203814 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.203765    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-n64g7_280f632b-36bf-46a9-b7a1-1d4ceb84cea8/storage-initializer/0.log"
May 28 19:01:46.214964 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.214895    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-n64g7_280f632b-36bf-46a9-b7a1-1d4ceb84cea8/main/0.log"
May 28 19:01:46.336190 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.336161    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp_8ea0ac3e-706f-4347-8cc4-6a57b9487e3a/storage-initializer/0.log"
May 28 19:01:46.344438 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.344415    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccsc6qp_8ea0ac3e-706f-4347-8cc4-6a57b9487e3a/main/0.log"
May 28 19:01:46.455763 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.455735    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4_08f05fdb-e554-454c-942f-33d804d6ff56/storage-initializer/0.log"
May 28 19:01:46.464150 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.464110    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-wdfp4_08f05fdb-e554-454c-942f-33d804d6ff56/main/0.log"
May 28 19:01:46.571414 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.571330    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw_501ba88b-1f09-4a58-90f9-b3d6ac61c24c/storage-initializer/0.log"
May 28 19:01:46.583528 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:46.583498    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-nqhlw_501ba88b-1f09-4a58-90f9-b3d6ac61c24c/main/0.log"
May 28 19:01:54.291991 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:54.291959    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f647h_6c599fce-b3fe-4ac8-8abd-b2550678327d/global-pull-secret-syncer/0.log"
May 28 19:01:54.361405 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:54.361371    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6w6jd_768c076d-17da-41b8-bb55-d5d5f6dbf22c/konnectivity-agent/0.log"
May 28 19:01:54.478267 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:54.478237    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-21.ec2.internal_db1aebaf26e9365f9d0caa1f85512259/haproxy/0.log"
May 28 19:01:58.826191 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:58.826145    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-ql2tr_72ece883-0670-4769-9625-e747624fef01/manager/0.log"
May 28 19:01:58.926300 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:01:58.926269    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2slqk_1dcf8da7-84c0-4acb-82d6-33e4e5ab9d16/registry-server/0.log"
May 28 19:02:00.879296 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:00.879266    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tq8g_3797f25f-126f-48f3-a235-3e74841217a8/node-exporter/0.log"
May 28 19:02:00.899124 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:00.899089    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tq8g_3797f25f-126f-48f3-a235-3e74841217a8/kube-rbac-proxy/0.log"
May 28 19:02:00.922599 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:00.922568    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6tq8g_3797f25f-126f-48f3-a235-3e74841217a8/init-textfile/0.log"
May 28 19:02:02.812635 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.812600    2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"]
May 28 19:02:02.813085 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.812977    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f22a3940-942d-42fc-a360-a7a0068fae89" containerName="manager"
May 28 19:02:02.813085 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.812990    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f22a3940-942d-42fc-a360-a7a0068fae89" containerName="manager"
May 28 19:02:02.813085 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.813054    2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f22a3940-942d-42fc-a360-a7a0068fae89" containerName="manager"
May 28 19:02:02.814989 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.814967    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.817439 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.817414    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8pbq\"/\"kube-root-ca.crt\""
May 28 19:02:02.817547 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.817414    2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8pbq\"/\"openshift-service-ca.crt\""
May 28 19:02:02.818347 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.818331    2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8pbq\"/\"default-dockercfg-9kfz9\""
May 28 19:02:02.823199 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.823176    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"]
May 28 19:02:02.870059 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.870017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-podres\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.870244 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.870107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k747w\" (UniqueName: \"kubernetes.io/projected/2ecf8889-a55a-4573-9ee8-c5af65431a7e-kube-api-access-k747w\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.870244 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.870138    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-sys\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.870244 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.870162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-lib-modules\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.870244 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.870186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-proc\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.970977 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.970943    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k747w\" (UniqueName: \"kubernetes.io/projected/2ecf8889-a55a-4573-9ee8-c5af65431a7e-kube-api-access-k747w\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971224 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971202    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-sys\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971271 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971254    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-lib-modules\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971306 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971289    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-proc\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971351 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971302    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-sys\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971351 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971338    2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-podres\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971418 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971363    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-proc\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971454 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971417    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-lib-modules\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.971488 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.971470    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2ecf8889-a55a-4573-9ee8-c5af65431a7e-podres\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:02.978921 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:02.978897    2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k747w\" (UniqueName: \"kubernetes.io/projected/2ecf8889-a55a-4573-9ee8-c5af65431a7e-kube-api-access-k747w\") pod \"perf-node-gather-daemonset-zftq7\" (UID: \"2ecf8889-a55a-4573-9ee8-c5af65431a7e\") " pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:03.125133 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.125098    2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:03.255239 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.255212    2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"]
May 28 19:02:03.257383 ip-10-0-139-21 kubenswrapper[2574]: W0528 19:02:03.257355    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2ecf8889_a55a_4573_9ee8_c5af65431a7e.slice/crio-d3d3a1d8c4eabc1000a02914cbb4ec41c2132157e31d159537f28458b01d7782 WatchSource:0}: Error finding container d3d3a1d8c4eabc1000a02914cbb4ec41c2132157e31d159537f28458b01d7782: Status 404 returned error can't find the container with id d3d3a1d8c4eabc1000a02914cbb4ec41c2132157e31d159537f28458b01d7782
May 28 19:02:03.259017 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.258997    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:02:03.993023 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.992985    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7" event={"ID":"2ecf8889-a55a-4573-9ee8-c5af65431a7e","Type":"ContainerStarted","Data":"64aceb10a26416966f4bb589f5dab14293edee9272587f876c4cd666a8523899"}
May 28 19:02:03.993023 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.993028    2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7" event={"ID":"2ecf8889-a55a-4573-9ee8-c5af65431a7e","Type":"ContainerStarted","Data":"d3d3a1d8c4eabc1000a02914cbb4ec41c2132157e31d159537f28458b01d7782"}
May 28 19:02:03.993456 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:03.993079    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:04.009934 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:04.009885    2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7" podStartSLOduration=2.009870824 podStartE2EDuration="2.009870824s" podCreationTimestamp="2026-05-28 19:02:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:02:04.008528711 +0000 UTC m=+2162.709005705" watchObservedRunningTime="2026-05-28 19:02:04.009870824 +0000 UTC m=+2162.710347815"
May 28 19:02:05.085162 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:05.085133    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx5nz_c3d51139-f5f4-4efc-be76-4f78b7d147b9/dns/0.log"
May 28 19:02:05.104777 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:05.104749    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx5nz_c3d51139-f5f4-4efc-be76-4f78b7d147b9/kube-rbac-proxy/0.log"
May 28 19:02:05.197637 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:05.197604    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-llntx_239af890-ff27-498d-b394-5c3c8a59b8ac/dns-node-resolver/0.log"
May 28 19:02:05.715342 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:05.715305    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v4ml8_ed201536-7fa5-4a2a-8c40-638237654c5c/node-ca/0.log"
May 28 19:02:06.718261 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:06.718223    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-vqvmc_0121e191-94ce-43b8-8c4c-e8703b197c8c/discovery/0.log"
May 28 19:02:06.736809 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:06.736763    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59c6767894-4c52b_ef0d14fb-544d-44d4-a4a0-e37533aa224c/kube-auth-proxy/0.log"
May 28 19:02:06.934051 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:06.934020    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-5xjh8_4e8bec75-6151-432d-b513-48048be21744/payload-processing/0.log"
May 28 19:02:07.479691 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:07.479660    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2grkj_5f99c87f-752c-44c4-8f70-d04ddc039dc2/serve-healthcheck-canary/0.log"
May 28 19:02:07.980035 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:07.980002    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cds5s_2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f/kube-rbac-proxy/0.log"
May 28 19:02:07.999473 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:07.999444    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cds5s_2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f/exporter/0.log"
May 28 19:02:08.031904 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:08.031877    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cds5s_2cd8d3f7-7a0c-4aee-8781-70f38eef2d9f/extractor/0.log"
May 28 19:02:10.007597 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.007552    2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8pbq/perf-node-gather-daemonset-zftq7"
May 28 19:02:10.080464 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.080428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-5ljj6_4b647287-efd4-42ac-898b-c54b2b7d2968/manager/0.log"
May 28 19:02:10.125020 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.124985    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-589f656766-65j8r_5f5bf1ef-325e-4cc1-931e-96140deadc33/maas-api/0.log"
May 28 19:02:10.296446 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.296356    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xq4l5_b111eb3c-da72-4f75-b0f0-7c1bdfe656dc/manager/0.log"
May 28 19:02:10.316292 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.316268    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-xq4l5_b111eb3c-da72-4f75-b0f0-7c1bdfe656dc/manager/1.log"
May 28 19:02:10.400001 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.399969    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b658c4654-glz86_9cb96d74-b15c-4261-b1a8-422d9764ca06/manager/0.log"
May 28 19:02:10.443105 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:10.443074    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-h2xrh_4b6d2e5e-7138-48f7-b7e6-b35e2232c54f/postgres/0.log"
May 28 19:02:17.336600 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.336556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/kube-multus-additional-cni-plugins/0.log"
May 28 19:02:17.356381 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.356346    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/egress-router-binary-copy/0.log"
May 28 19:02:17.381501 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.381478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/cni-plugins/0.log"
May 28 19:02:17.400943 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.400908    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/bond-cni-plugin/0.log"
May 28 19:02:17.421679 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.421646    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/routeoverride-cni/0.log"
May 28 19:02:17.442667 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.442643    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/whereabouts-cni-bincopy/0.log"
May 28 19:02:17.461554 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.461528    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tt4df_c6a2eb7e-ba5d-48a6-a223-fe80f229d218/whereabouts-cni/0.log"
May 28 19:02:17.640570 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.640543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gfzsd_ab263e52-6b54-41d3-b185-e2a19a83a578/kube-multus/0.log"
May 28 19:02:17.757056 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.757025    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9zf5t_8009cfe7-6d52-480c-9e82-d2379b9df5a5/network-metrics-daemon/0.log"
May 28 19:02:17.776311 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:17.776278    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9zf5t_8009cfe7-6d52-480c-9e82-d2379b9df5a5/kube-rbac-proxy/0.log"
May 28 19:02:18.921851 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:18.921752    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/ovn-controller/0.log"
May 28 19:02:18.959989 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:18.959958    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/ovn-acl-logging/0.log"
May 28 19:02:18.986892 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:18.986860    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/kube-rbac-proxy-node/0.log"
May 28 19:02:19.011021 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:19.010994    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/kube-rbac-proxy-ovn-metrics/0.log"
May 28 19:02:19.029234 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:19.029207    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/northd/0.log"
May 28 19:02:19.052422 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:19.052395    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/nbdb/0.log"
May 28 19:02:19.075112 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:19.075083    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/sbdb/0.log"
May 28 19:02:19.232238 ip-10-0-139-21 kubenswrapper[2574]: I0528 19:02:19.232158    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mkwsh_201c926e-8601-40f9-8d23-49b22c60d373/ovnkube-controller/0.log"