May 28 18:22:49.402708 ip-10-0-133-168 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 18:22:49.402719 ip-10-0-133-168 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 18:22:49.402726 ip-10-0-133-168 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 18:22:49.402957 ip-10-0-133-168 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 18:22:59.493996 ip-10-0-133-168 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 18:22:59.494013 ip-10-0-133-168 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d4bfad9ba3854a2bab45b12a93b16975 --
May 28 18:25:28.276854 ip-10-0-133-168 systemd[1]: Starting Kubernetes Kubelet...
May 28 18:25:28.670216 ip-10-0-133-168 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:25:28.670216 ip-10-0-133-168 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 18:25:28.670216 ip-10-0-133-168 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:25:28.670216 ip-10-0-133-168 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 18:25:28.671314 ip-10-0-133-168 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 18:25:28.673325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.673236    2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 18:25:28.676838 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676823    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:25:28.676838 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676838    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676842    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676846    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676849    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676852    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676855    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676858    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676862    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676865    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676868    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676871    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676873    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676876    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676879    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676882    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676884    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676887    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676889    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676892    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676894    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:25:28.676902 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676897    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676905    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676908    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676911    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676914    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676917    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676921    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676925    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676928    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676931    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676934    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676936    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676939    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676941    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676944    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676947    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676949    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676952    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676954    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:25:28.677374 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676957    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676961    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676965    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676967    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676970    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676974    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676977    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676980    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676982    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676984    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676987    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676990    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676992    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676995    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.676997    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677001    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677003    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677006    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677008    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677011    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:25:28.677846 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677014    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:25:28.678326 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677016    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:25:28.678326 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677019    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:25:28.678326 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.677021    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:25:28.679086 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679076    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:25:28.679086 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679086    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679089    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679093    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679096    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679099    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679103    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679107    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679110    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679113    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679115    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679118    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679121    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679123    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679126    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679129    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679131    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679134    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679136    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679139    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:25:28.679147 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679142    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679144    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679528    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679533    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679536    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679539    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679541    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679544    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679546    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679549    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679551    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679554    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679556    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679570    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679573    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679575    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679578    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679580    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679583    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679586    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:25:28.679620 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679590    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679594    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679596    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679599    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679602    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679604    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679607    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679609    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679611    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679614    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679616    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679619    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679621    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679624    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679627    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679630    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679633    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679635    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679638    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:25:28.680128 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679640    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679643    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679646    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679648    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679651    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679653    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679656    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679659    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679662    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679664    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679668    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679670    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679673    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679676    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679678    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679681    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679684    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679687    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679689    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679692    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:25:28.680614 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679694    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679696    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679699    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679701    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679704    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679706    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679709    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679711    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679713    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679716    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679719    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679721    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679723    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679726    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679728    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679731    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679733    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679737    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679741    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:25:28.681091 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679744    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679747    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679750    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679752    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679755    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679758    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679761    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679763    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679766    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.679769    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681045    2563 flags.go:64] FLAG: --address="0.0.0.0"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681055    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681062    2563 flags.go:64] FLAG: --anonymous-auth="true"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681066    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681071    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681075    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681079    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681083    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681087    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681090    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681094    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681097    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 18:25:28.681549 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681100    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681104    2563 flags.go:64] FLAG: --cgroup-root=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681107    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681110    2563 flags.go:64] FLAG: --client-ca-file=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681113    2563 flags.go:64] FLAG: --cloud-config=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681116    2563 flags.go:64] FLAG: --cloud-provider="external"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681120    2563 flags.go:64] FLAG: --cluster-dns="[]"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681125    2563 flags.go:64] FLAG: --cluster-domain=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681128    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681131    2563 flags.go:64] FLAG: --config-dir=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681134    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681137    2563 flags.go:64] FLAG: --container-log-max-files="5"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681141    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681144    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681147    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681150    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681153    2563 flags.go:64] FLAG: --contention-profiling="false"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681157    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681161    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681165    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681168    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681172    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681175    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681178    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681181    2563 flags.go:64] FLAG: --enable-load-reader="false"
May 28 18:25:28.682090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681184    2563 flags.go:64] FLAG: --enable-server="true"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681187    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681191    2563 flags.go:64] FLAG: --event-burst="100"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681194    2563 flags.go:64] FLAG: --event-qps="50"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681197    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681201    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681203    2563 flags.go:64] FLAG: --eviction-hard=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681207    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681210    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681213    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681217    2563 flags.go:64] FLAG: --eviction-soft=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681220    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681222    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681226    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681229    2563 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681232    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681235    2563 flags.go:64] FLAG: --fail-swap-on="true"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681238    2563 flags.go:64] FLAG: --feature-gates=""
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681241    2563 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681245    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681248    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681251    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681254    2563 flags.go:64] FLAG: --healthz-port="10248"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681257    2563 flags.go:64] FLAG: --help="false"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681259    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-133-168.ec2.internal"
May 28 18:25:28.682719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681263    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681267    2563 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681270    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681273    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681277    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681280    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681282    2563 flags.go:64] FLAG: --image-service-endpoint=""
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681285    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681288    2563 flags.go:64] FLAG: --kube-api-burst="100"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681291    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681294    2563 flags.go:64] FLAG: --kube-api-qps="50"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681297    2563 flags.go:64] FLAG: --kube-reserved=""
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681300    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681303    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681305    2563 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681308    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681311    2563 flags.go:64] FLAG: --lock-file=""
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681314    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681317    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681320    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681325    2563 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681329    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681332    2563 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 18:25:28.683311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681334    2563 flags.go:64] FLAG: --logging-format="text"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681337    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681340    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681343    2563 flags.go:64] FLAG: --manifest-url=""
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681346    2563 flags.go:64] FLAG: --manifest-url-header=""
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681355    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681358    2563 flags.go:64] FLAG: --max-open-files="1000000"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681362    2563 flags.go:64] FLAG: --max-pods="110"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681365    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681368    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681372    2563 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681375    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681378    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681381    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681384    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681392    2563 flags.go:64] FLAG: --node-status-max-images="50"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681395    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681398    2563 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681401    2563 flags.go:64] FLAG: --pod-cidr=""
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681404    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681410    2563 flags.go:64] FLAG: --pod-manifest-path=""
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681413    2563 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681416    2563 flags.go:64] FLAG: --pods-per-core="0"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681419    2563 flags.go:64] FLAG: --port="10250"
May 28 18:25:28.683876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681422    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681425    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c3aa1bf7434a0e5f"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681428    2563 flags.go:64] FLAG: --qos-reserved=""
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681431    2563 flags.go:64] FLAG: --read-only-port="10255"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681434    2563 flags.go:64] FLAG: --register-node="true"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681436    2563 flags.go:64] FLAG: --register-schedulable="true"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681440    2563 flags.go:64] FLAG: --register-with-taints=""
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681443    2563 flags.go:64] FLAG: --registry-burst="10"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681446    2563 flags.go:64] FLAG: --registry-qps="5"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681449    2563 flags.go:64] FLAG: --reserved-cpus=""
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681452    2563 flags.go:64] FLAG: --reserved-memory=""
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681456    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681459    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681462    2563 flags.go:64] FLAG: --rotate-certificates="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681465    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681467    2563 flags.go:64] FLAG: --runonce="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681470    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681473    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681476    2563 flags.go:64] FLAG: --seccomp-default="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681480    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681483    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681486    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681489    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681492    2563 flags.go:64] FLAG: --storage-driver-password="root"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681495    2563 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681498    2563 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 18:25:28.684438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681501    2563 flags.go:64] FLAG: --storage-driver-user="root"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681503    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681506    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681510    2563 flags.go:64] FLAG: --system-cgroups=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681512    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681518    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681521    2563 flags.go:64] FLAG: --tls-cert-file=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681523    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681528    2563 flags.go:64] FLAG: --tls-min-version=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681531    2563 flags.go:64] FLAG: --tls-private-key-file=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681534    2563 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681536    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681543    2563 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681547    2563 flags.go:64] FLAG: --v="2"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681551    2563 flags.go:64] FLAG: --version="false"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681555    2563 flags.go:64] FLAG: --vmodule=""
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681571    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681575    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681678    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681682    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681685    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681688    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681691    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:25:28.685101 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681693    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681696    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681699    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681708    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681711    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681713    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681716    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681718    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681721    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681723    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681726    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681728    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681731    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681734    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681736    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681739    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681742    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681744    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681747    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681749    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:25:28.685658 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681752    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681755    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681758    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681760    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681763    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681765    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681768    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681770    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681773    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681775    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681778    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681782    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681785    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681787    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681789    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681792    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681795    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681798    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681800    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681803    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:25:28.686158 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681805    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681807    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681810    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681812    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681815    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681817    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681820    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681822    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681825    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681827    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681830    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681832    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681834    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681837    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681840    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681843    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681845    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681848    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681850    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681853    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:25:28.686650 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681855    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681858    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681860    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681864    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681866    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681869    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681873    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681877    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681880    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681883    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681886    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681890    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681893    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681896    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681899    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681901    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681904    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681906    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:25:28.687141 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681909    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:25:28.687894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681911    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:25:28.687894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.681914    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:25:28.687894 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.681920    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:25:28.688837 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.688816    2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 18:25:28.688837 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.688838    2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688906    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688914    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688919    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688923    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688927    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688931    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688935    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688939    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688944    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688948    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688952    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688958    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688963    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688967    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688972    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688976    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688980    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688984    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:25:28.688981 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688988    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688993    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.688997    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689001    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689005    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689010    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689014    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689018    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689023    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689027    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689031    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689036    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689040    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689045    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689049    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689054    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689058    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689063    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689067    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689071    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:25:28.689894 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689075    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689079    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689083    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689089    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689095    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689099    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689103    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689107    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689111    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689115    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689119    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689123    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689127    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689131    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689136    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689140    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689144    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689149    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689153    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689157    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:25:28.690488 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689161    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689166    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689170    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689174    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689178    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689182    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689187    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689192    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689196    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689200    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689205    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689209    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689213    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689217    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689221    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689227    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689234    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689240    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689244    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689248    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:25:28.691067 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689253    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689257    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689262    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689266    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689270    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689274    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689278    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689284    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.689292    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689445    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689453    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689460    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689466    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689471    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689476    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 18:25:28.691795 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689481    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689485    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689489    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689493    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689498    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689503    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689507    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689511    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689515    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689519    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689523    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689527    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689532    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689536    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689540    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689544    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689548    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689552    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689558    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 18:25:28.692430 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689581    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689585    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689589    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689592    2563 feature_gate.go:328] unrecognized feature gate: Example2
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689597    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689601    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689605    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689609    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689613    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689617    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689621    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689626    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689630    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689634    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689638    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689642    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689646    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689650    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689655    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689659    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 18:25:28.693066 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689664    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689668    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689672    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689676    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689680    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689684    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689688    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689692    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689696    2563 feature_gate.go:328] unrecognized feature gate: Example
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689700    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689705    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689709    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689713    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689718    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689722    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689726    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689730    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689734    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689739    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689743    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 18:25:28.693667 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689747    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689751    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689755    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689759    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689763    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689767    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689771    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689775    2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689779    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689783    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689787    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689792    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689797    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689801    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689805    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689810    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689814    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689818    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689822    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 18:25:28.694183 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689826    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:28.689831    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.689838    2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.690582    2563 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.693490    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.694388    2563 server.go:1019] "Starting client certificate rotation"
May 28 18:25:28.694898 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.694489    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:25:28.695320 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.695309    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 18:25:28.715770 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.715745    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:25:28.720025 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.719941    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 18:25:28.735706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.735683    2563 log.go:25] "Validated CRI v1 runtime API"
May 28 18:25:28.741904 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.741889    2563 log.go:25] "Validated CRI v1 image API"
May 28 18:25:28.743214 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.743200    2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 18:25:28.746680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.746656    2563 fs.go:135] Filesystem UUIDs: map[481ddeca-4bd9-4d65-93ca-e5fad94624ae:/dev/nvme0n1p4 65afd952-ec64-47dc-88a9-fc8e7fbf755a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 28 18:25:28.746751 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.746680    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 18:25:28.750155 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.750140    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:25:28.751088 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.750974    2563 manager.go:217] Machine: {Timestamp:2026-05-28 18:25:28.750439016 +0000 UTC m=+0.369205989 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099808 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2593b5e1a847074202c097d4766b52 SystemUUID:ec2593b5-e1a8-4707-4202-c097d4766b52 BootID:d4bfad9b-a385-4a2b-ab45-b12a93b16975 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:89:bf:48:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:89:bf:48:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:95:61:99:e9:52 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 18:25:28.751678 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.751668    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 18:25:28.751761 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.751750    2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 18:25:28.753741 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.753715    2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 18:25:28.753883 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.753744    2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-168.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 18:25:28.753925 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.753893    2563 topology_manager.go:138] "Creating topology manager with none policy"
May 28 18:25:28.753925 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.753902    2563 container_manager_linux.go:306] "Creating device plugin manager"
May 28 18:25:28.753925 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.753909    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:25:28.755243 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.755233    2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 18:25:28.757328 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.757318    2563 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:25:28.757652 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.757642    2563 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 18:25:28.759753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.759744    2563 kubelet.go:491] "Attempting to sync node with API server"
May 28 18:25:28.759789 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.759758    2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 18:25:28.759789 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.759771    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 18:25:28.759789 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.759781    2563 kubelet.go:397] "Adding apiserver pod source"
May 28 18:25:28.759871 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.759791    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 18:25:28.760739 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.760728    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:25:28.760783 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.760748    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 18:25:28.763586 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.763555    2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 18:25:28.768205 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.768184    2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 18:25:28.769152 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769137    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769155    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769163    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769169    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769177    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769184    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769191    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769200    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769208    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769214    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 18:25:28.769231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.769236    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 18:25:28.772748 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.772733    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 18:25:28.772818 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.772772    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 18:25:28.772818 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.772782    2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 18:25:28.775319 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.775293    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 18:25:28.775696 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.775675    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 18:25:28.776135 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.776123    2563 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 18:25:28.776171 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.776162    2563 server.go:1295] "Started kubelet"
May 28 18:25:28.776243 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.776217    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 18:25:28.776301 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.776249    2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 18:25:28.776346 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.776300    2563 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 18:25:28.777124 ip-10-0-133-168 systemd[1]: Started Kubernetes Kubelet.
May 28 18:25:28.778028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.778017    2563 server.go:317] "Adding debug handlers to kubelet server"
May 28 18:25:28.779540 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.779524    2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 18:25:28.784015 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.783995    2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 18:25:28.785341 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.785326    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 18:25:28.785702 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.785684    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 18:25:28.785894 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.785878    2563 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 18:25:28.785894 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.785893    2563 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 18:25:28.786032 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.785921    2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 18:25:28.786032 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786009    2563 reconstruct.go:97] "Volume reconstruction finished"
May 28 18:25:28.786032 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786017    2563 reconciler.go:26] "Reconciler: start to sync state"
May 28 18:25:28.786407 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786366    2563 factory.go:55] Registering systemd factory
May 28 18:25:28.786407 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786385    2563 factory.go:223] Registration of the systemd container factory successfully
May 28 18:25:28.786514 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.786445    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:28.786646 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786609    2563 factory.go:153] Registering CRI-O factory
May 28 18:25:28.786726 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786649    2563 factory.go:223] Registration of the crio container factory successfully
May 28 18:25:28.786726 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786720    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 18:25:28.786823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786744    2563 factory.go:103] Registering Raw factory
May 28 18:25:28.786823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786750    2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-168.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 18:25:28.786823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.786773    2563 manager.go:1196] Started watching for new ooms in manager
May 28 18:25:28.787193 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.787181    2563 manager.go:319] Starting recovery of all containers
May 28 18:25:28.787694 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.786783    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-168.ec2.internal.18b3cdf4bd7ae01f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-168.ec2.internal,UID:ip-10-0-133-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-168.ec2.internal,},FirstTimestamp:2026-05-28 18:25:28.776138783 +0000 UTC m=+0.394905757,LastTimestamp:2026-05-28 18:25:28.776138783 +0000 UTC m=+0.394905757,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-168.ec2.internal,}"
May 28 18:25:28.790948 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.790920    2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 18:25:28.791255 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.791210    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-168.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 18:25:28.797526 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.797415    2563 manager.go:324] Recovery completed
May 28 18:25:28.799862 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.799839    2563 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 18:25:28.802955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.802943    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.804288 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.804273    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gz7fd"
May 28 18:25:28.804873 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.804861    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.804910 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.804888    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.804910 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.804902    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.805337 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.805324    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 18:25:28.805337 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.805336    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 18:25:28.805409 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.805351    2563 state_mem.go:36] "Initialized new in-memory state store"
May 28 18:25:28.806864 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.806798    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-168.ec2.internal.18b3cdf4bf315c6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-168.ec2.internal,UID:ip-10-0-133-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-168.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-168.ec2.internal,},FirstTimestamp:2026-05-28 18:25:28.804875372 +0000 UTC m=+0.423642345,LastTimestamp:2026-05-28 18:25:28.804875372 +0000 UTC m=+0.423642345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-168.ec2.internal,}"
May 28 18:25:28.808301 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.808289    2563 policy_none.go:49] "None policy: Start"
May 28 18:25:28.808347 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.808306    2563 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 18:25:28.808347 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.808316    2563 state_mem.go:35] "Initializing new in-memory state store"
May 28 18:25:28.814882 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.814867    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gz7fd"
May 28 18:25:28.817291 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.817228    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-168.ec2.internal.18b3cdf4bf31a8ee  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-168.ec2.internal,UID:ip-10-0-133-168.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-168.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-168.ec2.internal,},FirstTimestamp:2026-05-28 18:25:28.804894958 +0000 UTC m=+0.423661934,LastTimestamp:2026-05-28 18:25:28.804894958 +0000 UTC m=+0.423661934,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-168.ec2.internal,}"
May 28 18:25:28.857151 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857132    2563 manager.go:341] "Starting Device Plugin manager"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.857166    2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857179    2563 server.go:85] "Starting device plugin registration server"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857414    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857424    2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857502    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857579    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.857588    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.858175    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 18:25:28.865480 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.858217    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:28.884285 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.884245    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 18:25:28.885389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.885372    2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 18:25:28.885443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.885399    2563 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 18:25:28.885443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.885423    2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 18:25:28.885443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.885432    2563 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 18:25:28.885589 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.885476    2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 18:25:28.887745 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.887726    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:25:28.957659 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.957599    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.958762 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.958742    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.958864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.958778    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.958864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.958791    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.958864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.958820    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-168.ec2.internal"
May 28 18:25:28.971024 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.971005    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-168.ec2.internal"
May 28 18:25:28.971090 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.971027    2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-168.ec2.internal\": node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:28.986010 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.985985    2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"]
May 28 18:25:28.986096 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.986045    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.986819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.986806    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.986877 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.986832    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.986877 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.986841    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.987860 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.987849    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.988032 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988016    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:28.988090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988053    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.988458 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988445    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.988458 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988454    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.988599 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988473    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.988599 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988476    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.988599 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988487    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.988599 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.988490    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.989447 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.989432    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:28.989521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.989462    2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 18:25:28.990074 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.990061    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientMemory"
May 28 18:25:28.990130 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.990088    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasNoDiskPressure"
May 28 18:25:28.990130 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:28.990102    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeHasSufficientPID"
May 28 18:25:28.990909 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:28.990894    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.013192 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.013170    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-168.ec2.internal\" not found" node="ip-10-0-133-168.ec2.internal"
May 28 18:25:29.017528 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.017510    2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-168.ec2.internal\" not found" node="ip-10-0-133-168.ec2.internal"
May 28 18:25:29.092014 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.091990    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.187383 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.187354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.187471 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.187390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.187471 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.187415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325b5d6f3edda642a7db68c954fea7bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"325b5d6f3edda642a7db68c954fea7bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.192423 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.192407    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.288092 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288000    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.288092 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288044    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325b5d6f3edda642a7db68c954fea7bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"325b5d6f3edda642a7db68c954fea7bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.288092 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288064    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.288092 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.288311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7882712299c9d232b59aa0f7bcdb927-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal\" (UID: \"e7882712299c9d232b59aa0f7bcdb927\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.288311 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.288106    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/325b5d6f3edda642a7db68c954fea7bb-config\") pod \"kube-apiserver-proxy-ip-10-0-133-168.ec2.internal\" (UID: \"325b5d6f3edda642a7db68c954fea7bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.293073 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.293057    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.316220 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.316206    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.320912 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.320898    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:29.393326 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.393281    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.493792 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.493749    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.594337 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.594253    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.693970 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.693929    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 18:25:29.694528 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.694077    2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 18:25:29.695009 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.694987    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.785654 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.785623    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 18:25:29.796276 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.796258    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.804294 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.804274    2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 18:25:29.817244 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.817219    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 18:20:28 +0000 UTC" deadline="2028-01-06 07:45:02.279762003 +0000 UTC"
May 28 18:25:29.817244 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.817242    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14101h19m32.462523189s"
May 28 18:25:29.839508 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.839481    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8pgpl"
May 28 18:25:29.847583 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.847514    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8pgpl"
May 28 18:25:29.897085 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.897060    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:29.911712 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.911686    2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:25:29.914425 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.914403    2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:25:29.930379 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:29.930355    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325b5d6f3edda642a7db68c954fea7bb.slice/crio-cca22de60a449d25c801dab1ffefa4bc93b6d2c2f962a8ca7dda3a307557db69 WatchSource:0}: Error finding container cca22de60a449d25c801dab1ffefa4bc93b6d2c2f962a8ca7dda3a307557db69: Status 404 returned error can't find the container with id cca22de60a449d25c801dab1ffefa4bc93b6d2c2f962a8ca7dda3a307557db69
May 28 18:25:29.930660 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:29.930642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7882712299c9d232b59aa0f7bcdb927.slice/crio-edd82ef847d1c06021cfa97c7ec916e060ee1f08c7eb2d3b080af28313fdda9d WatchSource:0}: Error finding container edd82ef847d1c06021cfa97c7ec916e060ee1f08c7eb2d3b080af28313fdda9d: Status 404 returned error can't find the container with id edd82ef847d1c06021cfa97c7ec916e060ee1f08c7eb2d3b080af28313fdda9d
May 28 18:25:29.935662 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:29.935646    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:25:29.997856 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:29.997821    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:30.098407 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.098326    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:30.198855 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.198824    2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-168.ec2.internal\" not found"
May 28 18:25:30.269533 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.269500    2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:25:30.286409 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.286382    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal"
May 28 18:25:30.296099 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.296080    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:25:30.297279 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.297267    2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal"
May 28 18:25:30.311904 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.311879    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 18:25:30.760668 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.760629    2563 apiserver.go:52] "Watching apiserver"
May 28 18:25:30.769129 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.768869    2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 18:25:30.769410 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.769390    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9fk4r","openshift-image-registry/node-ca-6m2zp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal","openshift-multus/network-metrics-daemon-xmn9f","openshift-network-diagnostics/network-check-target-8zhg9","openshift-dns/node-resolver-zzxvm","openshift-multus/multus-additional-cni-plugins-mzpzd","openshift-multus/multus-bnwt6","openshift-network-operator/iptables-alerter-fxgv5","openshift-ovn-kubernetes/ovnkube-node-bqb48","kube-system/konnectivity-agent-4mljd","kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"]
May 28 18:25:30.773970 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.773929    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.774084 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.773980    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.776926 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.776688    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 18:25:30.776926 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.776741    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 18:25:30.776926 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.776763    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk2td\""
May 28 18:25:30.776926 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.776860    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 18:25:30.777197 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.777028    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-42m8h\""
May 28 18:25:30.777197 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.777033    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 18:25:30.777197 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.777160    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 18:25:30.778658 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.778502    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.780408 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780389    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 18:25:30.780827 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780715    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q4z5p\""
May 28 18:25:30.780827 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780764    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 18:25:30.780920 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780882    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.780964 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780952    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 18:25:30.780998 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.780970    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 18:25:30.780998 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.780968    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:30.781254 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.781240    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 18:25:30.782962 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.782943    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:30.783057 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.783005    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:30.785088 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.785052    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.787199 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.787108    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 18:25:30.787199 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.787113    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 18:25:30.787355 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.787221    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cmspv\""
May 28 18:25:30.787409 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.787390    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.787532 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.787490    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.789636 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.789415    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 18:25:30.789636 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.789436    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ksrm9\""
May 28 18:25:30.789781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.789701    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 18:25:30.789834 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.789813    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mpjtk\""
May 28 18:25:30.790494 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.790146    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.790494 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.790311    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 18:25:30.790494 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.790314    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 18:25:30.792344 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.792243    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 18:25:30.793596 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.792788    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:30.793596 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793273    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 18:25:30.793596 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793530    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 18:25:30.793917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793646    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 18:25:30.793917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793782    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 18:25:30.793917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793893    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 18:25:30.793917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.793900    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2ltts\""
May 28 18:25:30.795184 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.795169    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 18:25:30.795294 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.795278    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kktnp\""
May 28 18:25:30.795583 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.795542    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 18:25:30.796766 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.796307    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.797356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cnibin\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.797443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysconfig\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-sys\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-lib-modules\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnsn\" (UniqueName: \"kubernetes.io/projected/a41e462c-88e4-4bfd-b122-89d3db786e9f-kube-api-access-rpnsn\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vqtq\" (UniqueName: \"kubernetes.io/projected/5a7baa17-0558-4e1b-8905-a03070dc5514-kube-api-access-8vqtq\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-socket-dir-parent\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-var-lib-kubelet\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-tuned\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfjx\" (UniqueName: \"kubernetes.io/projected/2953c6b4-0ac6-4448-b422-f72618caf8b3-kube-api-access-rhfjx\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-os-release\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-bin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-kubernetes\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797916    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-run\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.797955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7baa17-0558-4e1b-8905-a03070dc5514-tmp-dir\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.797988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cnibin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-multus\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-hostroot\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798099    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a7baa17-0558-4e1b-8905-a03070dc5514-hosts-file\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2r5n\" (UniqueName: \"kubernetes.io/projected/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-kube-api-access-c2r5n\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-systemd\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-netns\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798325 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-kubelet\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-os-release\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798366    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-host\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-k8s-cni-cncf-io\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76mh\" (UniqueName: \"kubernetes.io/projected/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-kube-api-access-m76mh\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-iptables-alerter-script\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9f8p\" (UniqueName: \"kubernetes.io/projected/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-kube-api-access-r9f8p\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be20f7e5-caed-4be7-a16e-7006ca321b07-host\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798518    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-daemon-config\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-multus-certs\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-modprobe-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-conf\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-system-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798739    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snlb2\""
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798743    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cni-binary-copy\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-etc-kubernetes\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.798813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798809    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-host-slash\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be20f7e5-caed-4be7-a16e-7006ca321b07-serviceca\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzklz\" (UniqueName: \"kubernetes.io/projected/be20f7e5-caed-4be7-a16e-7006ca321b07-kube-api-access-zzklz\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798907    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798932    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-tmp\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.799474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.798965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-conf-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.848385 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.848355    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:20:29 +0000 UTC" deadline="2028-03-09 22:45:44.98775839 +0000 UTC"
May 28 18:25:30.848385 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.848385    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15628h20m14.139376918s"
May 28 18:25:30.887845 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.887819    2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 18:25:30.890039 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.889984    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"e7882712299c9d232b59aa0f7bcdb927","Type":"ContainerStarted","Data":"edd82ef847d1c06021cfa97c7ec916e060ee1f08c7eb2d3b080af28313fdda9d"}
May 28 18:25:30.891044 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.891022    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" event={"ID":"325b5d6f3edda642a7db68c954fea7bb","Type":"ContainerStarted","Data":"cca22de60a449d25c801dab1ffefa4bc93b6d2c2f962a8ca7dda3a307557db69"}
May 28 18:25:30.899294 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.899411 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899311    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-conf\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.899411 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899345    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-system-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.899411 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899368    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-host-slash\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.899411 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-var-lib-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899422    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899430    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-system-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-kubelet\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-host-slash\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899490    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-conf\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899515    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-etc-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899551    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cnibin\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.899614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899590    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysconfig\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899619    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vqtq\" (UniqueName: \"kubernetes.io/projected/5a7baa17-0558-4e1b-8905-a03070dc5514-kube-api-access-8vqtq\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899632    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cnibin\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899646    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-socket-dir-parent\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899672    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-bin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysconfig\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899723    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-bin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-socket-dir-parent\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899785    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-etc-kubernetes\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899812    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzklz\" (UniqueName: \"kubernetes.io/projected/be20f7e5-caed-4be7-a16e-7006ca321b07-kube-api-access-zzklz\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-slash\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899868    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899894    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfjx\" (UniqueName: \"kubernetes.io/projected/2953c6b4-0ac6-4448-b422-f72618caf8b3-kube-api-access-rhfjx\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-etc-kubernetes\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-netns\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-systemd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.899971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-ovn\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900029 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900022    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-env-overrides\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz7rb\" (UniqueName: \"kubernetes.io/projected/7f546374-21c0-4cba-a4ba-2572c1486cd3-kube-api-access-zz7rb\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900105    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-kubernetes\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900135    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cnibin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900159    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-multus\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900183    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-hostroot\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-kubernetes\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900210    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-multus-certs\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cnibin\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900236    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-cni-multus\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900248    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-multus-certs\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-script-lib\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-hostroot\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15d72bb3-b98a-402e-8e31-da72e5c96f6b-agent-certs\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900322    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a7baa17-0558-4e1b-8905-a03070dc5514-hosts-file\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900350    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.900805 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900386    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5a7baa17-0558-4e1b-8905-a03070dc5514-hosts-file\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900374    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-kubelet\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900408    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-var-lib-kubelet\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900434    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-os-release\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900462    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-iptables-alerter-script\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-log-socket\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900522    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900543    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-os-release\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-device-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900589    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-modprobe-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900782    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-modprobe-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901024    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-iptables-alerter-script\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.900612    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cni-binary-copy\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901080    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901108    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-tmp\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901133    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-conf-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901154    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-sys\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.901521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901168    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-cni-binary-copy\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901210    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-sys\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-conf-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901245    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-lib-modules\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901253    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901272    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnsn\" (UniqueName: \"kubernetes.io/projected/a41e462c-88e4-4bfd-b122-89d3db786e9f-kube-api-access-rpnsn\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901296    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901317    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be20f7e5-caed-4be7-a16e-7006ca321b07-serviceca\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-netd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-lib-modules\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.901397    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901410    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901417    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-var-lib-kubelet\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901443    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-tuned\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-var-lib-kubelet\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.902286 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.901491    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:25:31.401454425 +0000 UTC m=+3.020221400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901514    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901540    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-os-release\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901582    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-cni-dir\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901582    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9f8p\" (UniqueName: \"kubernetes.io/projected/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-kube-api-access-r9f8p\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-config\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901663    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-os-release\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901732    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901770    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/be20f7e5-caed-4be7-a16e-7006ca321b07-serviceca\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901774    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901803    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-run\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-system-cni-dir\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901825    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7baa17-0558-4e1b-8905-a03070dc5514-tmp-dir\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15d72bb3-b98a-402e-8e31-da72e5c96f6b-konnectivity-ca\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-registration-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjhs\" (UniqueName: \"kubernetes.io/projected/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kube-api-access-bqjhs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.903075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901920    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-sysctl-d\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901934    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.901958    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c2r5n\" (UniqueName: \"kubernetes.io/projected/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-kube-api-access-c2r5n\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902059    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-systemd\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902106    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-netns\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902108    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a7baa17-0558-4e1b-8905-a03070dc5514-tmp-dir\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902125    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m76mh\" (UniqueName: \"kubernetes.io/projected/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-kube-api-access-m76mh\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902150    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be20f7e5-caed-4be7-a16e-7006ca321b07-host\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-node-log\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902191    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-host\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902215    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-k8s-cni-cncf-io\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-socket-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902301    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-sys-fs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902327    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-daemon-config\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902331    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-systemd\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-systemd-units\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.903824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902370    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-netns\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.904519 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-bin\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:30.904519 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.902377    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.906258 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-host\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.906361 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-host-run-k8s-cni-cncf-io\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.906474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a41e462c-88e4-4bfd-b122-89d3db786e9f-run\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906692    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-tmp\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.906725    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-multus-daemon-config\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.906750    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.906786    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.906768    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a41e462c-88e4-4bfd-b122-89d3db786e9f-etc-tuned\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.906885 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:30.906855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:25:31.406832118 +0000 UTC m=+3.025599096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:30.907247 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.907004    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/be20f7e5-caed-4be7-a16e-7006ca321b07-host\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.909200 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.909122    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfjx\" (UniqueName: \"kubernetes.io/projected/2953c6b4-0ac6-4448-b422-f72618caf8b3-kube-api-access-rhfjx\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:30.909368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.909347    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzklz\" (UniqueName: \"kubernetes.io/projected/be20f7e5-caed-4be7-a16e-7006ca321b07-kube-api-access-zzklz\") pod \"node-ca-6m2zp\" (UID: \"be20f7e5-caed-4be7-a16e-7006ca321b07\") " pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:30.910430 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.910410    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vqtq\" (UniqueName: \"kubernetes.io/projected/5a7baa17-0558-4e1b-8905-a03070dc5514-kube-api-access-8vqtq\") pod \"node-resolver-zzxvm\" (UID: \"5a7baa17-0558-4e1b-8905-a03070dc5514\") " pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:30.914361 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.914343    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnsn\" (UniqueName: \"kubernetes.io/projected/a41e462c-88e4-4bfd-b122-89d3db786e9f-kube-api-access-rpnsn\") pod \"tuned-9fk4r\" (UID: \"a41e462c-88e4-4bfd-b122-89d3db786e9f\") " pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:30.915321 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.915302    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9f8p\" (UniqueName: \"kubernetes.io/projected/7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187-kube-api-access-r9f8p\") pod \"iptables-alerter-fxgv5\" (UID: \"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187\") " pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:30.915467 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.915446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2r5n\" (UniqueName: \"kubernetes.io/projected/f3cde208-3b7f-4b2d-88f2-d0390cdb5c35-kube-api-access-c2r5n\") pod \"multus-additional-cni-plugins-mzpzd\" (UID: \"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35\") " pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:30.915714 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:30.915698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76mh\" (UniqueName: \"kubernetes.io/projected/27d8438d-b992-4b7e-9600-b5f3d0ea4b90-kube-api-access-m76mh\") pod \"multus-bnwt6\" (UID: \"27d8438d-b992-4b7e-9600-b5f3d0ea4b90\") " pod="openshift-multus/multus-bnwt6"
May 28 18:25:31.003476 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003438    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-kubelet\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003476 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003477    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-etc-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003498    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-slash\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003518    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-netns\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003545    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-systemd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-etc-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003576    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-slash\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003582    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-ovn\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-netns\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003556    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-kubelet\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003619    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-systemd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003639    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-ovn\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003639    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-env-overrides\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003686    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7rb\" (UniqueName: \"kubernetes.io/projected/7f546374-21c0-4cba-a4ba-2572c1486cd3-kube-api-access-zz7rb\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003718    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-script-lib\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.003727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003735    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15d72bb3-b98a-402e-8e31-da72e5c96f6b-agent-certs\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003857    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-log-socket\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003888    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003914    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-device-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003957    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.003980    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-netd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004014    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004044    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-config\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004057    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-device-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004077    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-env-overrides\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-run-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004123    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004106    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15d72bb3-b98a-402e-8e31-da72e5c96f6b-konnectivity-ca\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-netd\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004169    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-log-socket\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004174    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-registration-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.004368 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004209    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-registration-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004213    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjhs\" (UniqueName: \"kubernetes.io/projected/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kube-api-access-bqjhs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004250    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-node-log\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004278    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004282    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-script-lib\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004303    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-socket-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004313    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-etc-selinux\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004337    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-sys-fs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004348    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-run-ovn-kubernetes\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-node-log\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004365    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-systemd-units\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004398    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-bin\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004421    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004449    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-var-lib-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004453    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-socket-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004531    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-sys-fs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004588    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-host-cni-bin\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.005202 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004620    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovnkube-config\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.006112 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-systemd-units\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.006112 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004627    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7f546374-21c0-4cba-a4ba-2572c1486cd3-var-lib-openvswitch\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.006112 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004693    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.006112 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.004932    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/15d72bb3-b98a-402e-8e31-da72e5c96f6b-konnectivity-ca\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:31.006340 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.006318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/15d72bb3-b98a-402e-8e31-da72e5c96f6b-agent-certs\") pod \"konnectivity-agent-4mljd\" (UID: \"15d72bb3-b98a-402e-8e31-da72e5c96f6b\") " pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:31.007054 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.007029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f546374-21c0-4cba-a4ba-2572c1486cd3-ovn-node-metrics-cert\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.012408 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.012349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7rb\" (UniqueName: \"kubernetes.io/projected/7f546374-21c0-4cba-a4ba-2572c1486cd3-kube-api-access-zz7rb\") pod \"ovnkube-node-bqb48\" (UID: \"7f546374-21c0-4cba-a4ba-2572c1486cd3\") " pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.012500 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.012419    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjhs\" (UniqueName: \"kubernetes.io/projected/28cf1140-8e3f-402a-9b5e-f1f5d80d479f-kube-api-access-bqjhs\") pod \"aws-ebs-csi-driver-node-g5plz\" (UID: \"28cf1140-8e3f-402a-9b5e-f1f5d80d479f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.020433 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.020411    2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 18:25:31.086401 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.086356    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zzxvm"
May 28 18:25:31.098358 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.098333    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzpzd"
May 28 18:25:31.108213 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.108175    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6m2zp"
May 28 18:25:31.112053 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.112037    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9fk4r"
May 28 18:25:31.118601 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.118580    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bnwt6"
May 28 18:25:31.125099 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.125074    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fxgv5"
May 28 18:25:31.131733 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.131716    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:31.137257 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.137238    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:31.140727 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.140708    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz"
May 28 18:25:31.406690 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.406595    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:31.406873 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.406767    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:31.406873 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.406843    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:25:32.406824142 +0000 UTC m=+4.025591120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:31.507829 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.507789    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:31.507997 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.507969    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:31.507997 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.507996    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:31.508099 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.508012    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:31.508099 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:31.508075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:25:32.508053987 +0000 UTC m=+4.126820956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:31.601586 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.601481    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f546374_21c0_4cba_a4ba_2572c1486cd3.slice/crio-a5966a52219a292ab30acc1fb4e5874e01abd03c020a2b4ed78badb175a297d5 WatchSource:0}: Error finding container a5966a52219a292ab30acc1fb4e5874e01abd03c020a2b4ed78badb175a297d5: Status 404 returned error can't find the container with id a5966a52219a292ab30acc1fb4e5874e01abd03c020a2b4ed78badb175a297d5
May 28 18:25:31.602766 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.602671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cf1140_8e3f_402a_9b5e_f1f5d80d479f.slice/crio-4ed1aba77f2dd0a65ccf0a84037c73eb99d7fa5580738aa7ad7b8b3cb92fc561 WatchSource:0}: Error finding container 4ed1aba77f2dd0a65ccf0a84037c73eb99d7fa5580738aa7ad7b8b3cb92fc561: Status 404 returned error can't find the container with id 4ed1aba77f2dd0a65ccf0a84037c73eb99d7fa5580738aa7ad7b8b3cb92fc561
May 28 18:25:31.607772 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.607739    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe20f7e5_caed_4be7_a16e_7006ca321b07.slice/crio-da1554bc104864c96546477e4b9713d4ff297fe2d155a1d55590abcd01e28666 WatchSource:0}: Error finding container da1554bc104864c96546477e4b9713d4ff297fe2d155a1d55590abcd01e28666: Status 404 returned error can't find the container with id da1554bc104864c96546477e4b9713d4ff297fe2d155a1d55590abcd01e28666
May 28 18:25:31.608540 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.608520    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d72bb3_b98a_402e_8e31_da72e5c96f6b.slice/crio-1f2369c7f091a4aeb79ccc7834ee983e3b04f45bbd043f8796c9ec9ae2d9fbb1 WatchSource:0}: Error finding container 1f2369c7f091a4aeb79ccc7834ee983e3b04f45bbd043f8796c9ec9ae2d9fbb1: Status 404 returned error can't find the container with id 1f2369c7f091a4aeb79ccc7834ee983e3b04f45bbd043f8796c9ec9ae2d9fbb1
May 28 18:25:31.609326 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.609268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cde208_3b7f_4b2d_88f2_d0390cdb5c35.slice/crio-1c46ed0cb1ba9bb627a8197a59925d31fa0189be2918e01df1639635bb2507e1 WatchSource:0}: Error finding container 1c46ed0cb1ba9bb627a8197a59925d31fa0189be2918e01df1639635bb2507e1: Status 404 returned error can't find the container with id 1c46ed0cb1ba9bb627a8197a59925d31fa0189be2918e01df1639635bb2507e1
May 28 18:25:31.609979 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.609954    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7baa17_0558_4e1b_8905_a03070dc5514.slice/crio-81cb482c3e4f6812cf89c93a53027bfe2754c9fd4fe8003e89a55943a932a7c7 WatchSource:0}: Error finding container 81cb482c3e4f6812cf89c93a53027bfe2754c9fd4fe8003e89a55943a932a7c7: Status 404 returned error can't find the container with id 81cb482c3e4f6812cf89c93a53027bfe2754c9fd4fe8003e89a55943a932a7c7
May 28 18:25:31.611318 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.611217    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41e462c_88e4_4bfd_b122_89d3db786e9f.slice/crio-7f3fe8dab63698db3c6388bf90361586d9c013a0bb2f98425b93d2bc4fdbf99c WatchSource:0}: Error finding container 7f3fe8dab63698db3c6388bf90361586d9c013a0bb2f98425b93d2bc4fdbf99c: Status 404 returned error can't find the container with id 7f3fe8dab63698db3c6388bf90361586d9c013a0bb2f98425b93d2bc4fdbf99c
May 28 18:25:31.612660 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.612546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d8438d_b992_4b7e_9600_b5f3d0ea4b90.slice/crio-50ca614c9ab639215449b874aac51c56b1b58727f46fee34a0e04e543b1cbc1b WatchSource:0}: Error finding container 50ca614c9ab639215449b874aac51c56b1b58727f46fee34a0e04e543b1cbc1b: Status 404 returned error can't find the container with id 50ca614c9ab639215449b874aac51c56b1b58727f46fee34a0e04e543b1cbc1b
May 28 18:25:31.613021 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:25:31.612979    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e43e7_3e5a_42c2_9ed4_7d00e4ef8187.slice/crio-3e0badaefc800d040b5ced010467aa72d23673b1bd7e236527aa7cfa66f78974 WatchSource:0}: Error finding container 3e0badaefc800d040b5ced010467aa72d23673b1bd7e236527aa7cfa66f78974: Status 404 returned error can't find the container with id 3e0badaefc800d040b5ced010467aa72d23673b1bd7e236527aa7cfa66f78974
May 28 18:25:31.848887 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.848705    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 18:20:29 +0000 UTC" deadline="2028-01-08 18:24:26.796424864 +0000 UTC"
May 28 18:25:31.848887 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.848882    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14159h58m54.947545472s"
May 28 18:25:31.893412 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.893385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" event={"ID":"325b5d6f3edda642a7db68c954fea7bb","Type":"ContainerStarted","Data":"f864019467c3905e890a21e85fef082b47faf14da1113ea26518c94c797e0e75"}
May 28 18:25:31.894852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.894649    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fxgv5" event={"ID":"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187","Type":"ContainerStarted","Data":"3e0badaefc800d040b5ced010467aa72d23673b1bd7e236527aa7cfa66f78974"}
May 28 18:25:31.897389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.897366    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fk4r" event={"ID":"a41e462c-88e4-4bfd-b122-89d3db786e9f","Type":"ContainerStarted","Data":"7f3fe8dab63698db3c6388bf90361586d9c013a0bb2f98425b93d2bc4fdbf99c"}
May 28 18:25:31.898747 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.898724    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerStarted","Data":"1c46ed0cb1ba9bb627a8197a59925d31fa0189be2918e01df1639635bb2507e1"}
May 28 18:25:31.899790 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.899771    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mljd" event={"ID":"15d72bb3-b98a-402e-8e31-da72e5c96f6b","Type":"ContainerStarted","Data":"1f2369c7f091a4aeb79ccc7834ee983e3b04f45bbd043f8796c9ec9ae2d9fbb1"}
May 28 18:25:31.900713 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.900690    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6m2zp" event={"ID":"be20f7e5-caed-4be7-a16e-7006ca321b07","Type":"ContainerStarted","Data":"da1554bc104864c96546477e4b9713d4ff297fe2d155a1d55590abcd01e28666"}
May 28 18:25:31.902619 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.902594    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnwt6" event={"ID":"27d8438d-b992-4b7e-9600-b5f3d0ea4b90","Type":"ContainerStarted","Data":"50ca614c9ab639215449b874aac51c56b1b58727f46fee34a0e04e543b1cbc1b"}
May 28 18:25:31.903592 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.903551    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zzxvm" event={"ID":"5a7baa17-0558-4e1b-8905-a03070dc5514","Type":"ContainerStarted","Data":"81cb482c3e4f6812cf89c93a53027bfe2754c9fd4fe8003e89a55943a932a7c7"}
May 28 18:25:31.904533 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.904516    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz" event={"ID":"28cf1140-8e3f-402a-9b5e-f1f5d80d479f","Type":"ContainerStarted","Data":"4ed1aba77f2dd0a65ccf0a84037c73eb99d7fa5580738aa7ad7b8b3cb92fc561"}
May 28 18:25:31.905308 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.905289    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"a5966a52219a292ab30acc1fb4e5874e01abd03c020a2b4ed78badb175a297d5"}
May 28 18:25:31.908863 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:31.907717    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-168.ec2.internal" podStartSLOduration=1.907699553 podStartE2EDuration="1.907699553s" podCreationTimestamp="2026-05-28 18:25:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:25:31.906845862 +0000 UTC m=+3.525612846" watchObservedRunningTime="2026-05-28 18:25:31.907699553 +0000 UTC m=+3.526466541"
May 28 18:25:32.414066 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.414031    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:32.414246 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.414197    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:32.414315 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.414270    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:25:34.414250783 +0000 UTC m=+6.033017758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:32.514864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.514825    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:32.515057 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.515037    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:32.515123 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.515065    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:32.515123 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.515077    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:32.515226 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.515134    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:25:34.515116076 +0000 UTC m=+6.133883043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:32.886700 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.886166    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:32.886700 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.886284    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:32.887454 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.887304    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:32.887454 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:32.887415    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:32.920382 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.920257    2563 generic.go:358] "Generic (PLEG): container finished" podID="e7882712299c9d232b59aa0f7bcdb927" containerID="1385eb478a3fa80cd7f80ce52671b1fedb400b5d2b97c6e8450c103d556d3434" exitCode=0
May 28 18:25:32.920382 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:32.920341    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"e7882712299c9d232b59aa0f7bcdb927","Type":"ContainerDied","Data":"1385eb478a3fa80cd7f80ce52671b1fedb400b5d2b97c6e8450c103d556d3434"}
May 28 18:25:33.934423 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:33.934385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" event={"ID":"e7882712299c9d232b59aa0f7bcdb927","Type":"ContainerStarted","Data":"43c8cee0b786a7311733d29bc9345c12bb100469617fa597a35ac9252d080a8e"}
May 28 18:25:34.432089 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:34.431963    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:34.432265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.432122    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:34.432265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.432189    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:25:38.432169403 +0000 UTC m=+10.050936370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:34.532916 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:34.532308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:34.533649 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.532557    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:34.533649 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.533185    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:34.533649 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.533210    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:34.533649 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.533275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:25:38.533255388 +0000 UTC m=+10.152022370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:34.887234 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:34.886679    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:34.887234 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.886817    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:34.887234 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:34.887057    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:34.887234 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:34.887167    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:36.886688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:36.886652    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:36.886688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:36.886685    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:36.887223 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:36.886814    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:36.887223 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:36.887092    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:38.463393 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:38.463358    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:38.463854 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.463528    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:38.463854 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.463624    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:25:46.463604055 +0000 UTC m=+18.082371020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:38.563946 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:38.563908    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:38.564140 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.564064    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:38.564140 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.564087    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:38.564140 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.564100    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:38.564284 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.564168    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:25:46.56414904 +0000 UTC m=+18.182916002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:38.887350 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:38.887039    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:38.887350 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:38.887142    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:38.887350 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.887269    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:38.887350 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:38.887151    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:40.885955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:40.885918    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:40.886378 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:40.886045    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:40.886378 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:40.886258    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:40.886494 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:40.886376    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:42.885899 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:42.885861    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:42.886282 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:42.885992    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:42.886282 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:42.886041    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:42.886282 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:42.886136    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:44.886406 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:44.886368    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:44.886921 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:44.886482    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:44.886921 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:44.886546    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:44.886921 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:44.886750    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:46.523313 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:46.523274    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:46.523803 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.523427    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:46.523803 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.523487    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:02.523468893 +0000 UTC m=+34.142235857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:25:46.624189 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:46.624154    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:46.624343 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.624297    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:25:46.624343 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.624317    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:25:46.624343 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.624331    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:46.624487 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.624391    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:26:02.624372995 +0000 UTC m=+34.243139961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:25:46.886219 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:46.886185    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:46.886389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:46.886201    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:46.886389 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.886294    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:46.886389 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:46.886345    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:48.886676 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:48.886642    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:48.887139 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:48.886762    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:48.887139 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:48.886816    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:48.887139 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:48.886941    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:50.886659 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.886324    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:50.887336 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.886344    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:50.887336 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:50.886763    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:50.887336 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:50.886804    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:50.964081 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.964041    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mljd" event={"ID":"15d72bb3-b98a-402e-8e31-da72e5c96f6b","Type":"ContainerStarted","Data":"6d3fef5126ad1313216420d590f0cd587e2b39576b3a56950e380e11fa4c7d30"}
May 28 18:25:50.965553 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.965519    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6m2zp" event={"ID":"be20f7e5-caed-4be7-a16e-7006ca321b07","Type":"ContainerStarted","Data":"36a07b80b7969616e213fd3f140d542b7f60badb756a5ec8450547bcb6b77877"}
May 28 18:25:50.966866 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.966843    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bnwt6" event={"ID":"27d8438d-b992-4b7e-9600-b5f3d0ea4b90","Type":"ContainerStarted","Data":"61c5703a8c9959f7a8e7ea5cd7458512f8e5cef9d52af9fb70c74e7a873adb7a"}
May 28 18:25:50.968013 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.967995    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zzxvm" event={"ID":"5a7baa17-0558-4e1b-8905-a03070dc5514","Type":"ContainerStarted","Data":"da781dd2b27bbccdf2105cd88fa951eac563455db086cb2e0c7c7d5d0a7a45b0"}
May 28 18:25:50.969221 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.969203    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz" event={"ID":"28cf1140-8e3f-402a-9b5e-f1f5d80d479f","Type":"ContainerStarted","Data":"9dbc3d44dde4b928ca9e2932a9329a4651843f72ca93d40c8a95895f3c10877c"}
May 28 18:25:50.971722 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971698    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"c591f1052e1614786d3e11dffae7f02f7810dbbed016128349cd604a9a96a7ee"}
May 28 18:25:50.971819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971728    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"fead147648db5bff650ddd924e283fea7f134649b3c1262612757bdc7211ce33"}
May 28 18:25:50.971819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971741    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"c42c1ae758bd2a74cde6b266048027fcbc5e2814cc401b15d2f1c50244e42f29"}
May 28 18:25:50.971819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971753    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"5bc5c1ce23d5e463556dfe52e19902cb374eb3f4eaa40baa312dfc1c917e9b20"}
May 28 18:25:50.971819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971765    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"9ed09b386407b11f9ede2b0341032082626432fbc4e9abc9faaa6ab7d0936c1f"}
May 28 18:25:50.971819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.971795    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"36e770fa998fcf76cc2f329a9c00aaa89064ede171c214099482426ccc52df7c"}
May 28 18:25:50.973038 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.973018    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9fk4r" event={"ID":"a41e462c-88e4-4bfd-b122-89d3db786e9f","Type":"ContainerStarted","Data":"eea04ba6e13bb469625c86ba7f33c35b4db0a2dd313ce83ed5f55ec18f6d7c91"}
May 28 18:25:50.974378 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.974358    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="7cfc2f33f9296169c45e3fdec3c3c1ac9a2a0251befa191d614ab496dbf55847" exitCode=0
May 28 18:25:50.974461 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:50.974388    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"7cfc2f33f9296169c45e3fdec3c3c1ac9a2a0251befa191d614ab496dbf55847"}
May 28 18:25:51.009224 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.009173    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4mljd" podStartSLOduration=3.742284095 podStartE2EDuration="22.009157542s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.610576474 +0000 UTC m=+3.229343449" lastFinishedPulling="2026-05-28 18:25:49.877449923 +0000 UTC m=+21.496216896" observedRunningTime="2026-05-28 18:25:51.008889924 +0000 UTC m=+22.627656905" watchObservedRunningTime="2026-05-28 18:25:51.009157542 +0000 UTC m=+22.627924526"
May 28 18:25:51.009454 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.009431    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-168.ec2.internal" podStartSLOduration=21.00942508 podStartE2EDuration="21.00942508s" podCreationTimestamp="2026-05-28 18:25:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:25:33.948264344 +0000 UTC m=+5.567031329" watchObservedRunningTime="2026-05-28 18:25:51.00942508 +0000 UTC m=+22.628192063"
May 28 18:25:51.078941 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.078890    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9fk4r" podStartSLOduration=3.814571526 podStartE2EDuration="22.078874267s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.613200649 +0000 UTC m=+3.231967615" lastFinishedPulling="2026-05-28 18:25:49.877503392 +0000 UTC m=+21.496270356" observedRunningTime="2026-05-28 18:25:51.036496885 +0000 UTC m=+22.655263870" watchObservedRunningTime="2026-05-28 18:25:51.078874267 +0000 UTC m=+22.697641243"
May 28 18:25:51.079288 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.079262    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bnwt6" podStartSLOduration=3.77764362 podStartE2EDuration="22.079257037s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.614527885 +0000 UTC m=+3.233294848" lastFinishedPulling="2026-05-28 18:25:49.916141297 +0000 UTC m=+21.534908265" observedRunningTime="2026-05-28 18:25:51.078972529 +0000 UTC m=+22.697739513" watchObservedRunningTime="2026-05-28 18:25:51.079257037 +0000 UTC m=+22.698024019"
May 28 18:25:51.115984 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.115907    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6m2zp" podStartSLOduration=9.431668036 podStartE2EDuration="23.115893349s" podCreationTimestamp="2026-05-28 18:25:28 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.609759636 +0000 UTC m=+3.228526599" lastFinishedPulling="2026-05-28 18:25:45.293984947 +0000 UTC m=+16.912751912" observedRunningTime="2026-05-28 18:25:51.109255422 +0000 UTC m=+22.728022406" watchObservedRunningTime="2026-05-28 18:25:51.115893349 +0000 UTC m=+22.734660325"
May 28 18:25:51.362358 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.362328    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 18:25:51.444365 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.444285    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:51.873151 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.873041    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T18:25:51.362348828Z","UUID":"c8620624-8e98-4ad9-ac83-f870232dd459","Handler":null,"Name":"","Endpoint":""}
May 28 18:25:51.874660 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.874638    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 18:25:51.874794 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.874668    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 18:25:51.977611 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.977556    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fxgv5" event={"ID":"7f9e43e7-3e5a-42c2-9ed4-7d00e4ef8187","Type":"ContainerStarted","Data":"d61765b51955dcd4a98f56d718a071850e7717df385ff085c2cee9b541ee3918"}
May 28 18:25:51.979482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.979456    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz" event={"ID":"28cf1140-8e3f-402a-9b5e-f1f5d80d479f","Type":"ContainerStarted","Data":"9f257aa0a337d4112d569fde7239f4732705c20a69ade2ac9160e60def0ac8ff"}
May 28 18:25:51.991014 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.990967    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zzxvm" podStartSLOduration=5.726245062 podStartE2EDuration="23.990954958s" podCreationTimestamp="2026-05-28 18:25:28 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.613225712 +0000 UTC m=+3.231992673" lastFinishedPulling="2026-05-28 18:25:49.877935598 +0000 UTC m=+21.496702569" observedRunningTime="2026-05-28 18:25:51.177854228 +0000 UTC m=+22.796621211" watchObservedRunningTime="2026-05-28 18:25:51.990954958 +0000 UTC m=+23.609721991"
May 28 18:25:51.991243 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:51.991208    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fxgv5" podStartSLOduration=4.72876026 podStartE2EDuration="22.991199744s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.615016814 +0000 UTC m=+3.233783783" lastFinishedPulling="2026-05-28 18:25:49.877456295 +0000 UTC m=+21.496223267" observedRunningTime="2026-05-28 18:25:51.991108084 +0000 UTC m=+23.609875068" watchObservedRunningTime="2026-05-28 18:25:51.991199744 +0000 UTC m=+23.609966728"
May 28 18:25:52.385897 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.385869    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:52.386442 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.386422    2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:52.885999 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.885815    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:52.886180 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.885815    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:52.886180 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:52.886083    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:52.886180 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:52.886132    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:52.985081 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.985045    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz" event={"ID":"28cf1140-8e3f-402a-9b5e-f1f5d80d479f","Type":"ContainerStarted","Data":"93ba4ef85374b72a28cbd8255d706f3cfce204a3c892ff87a58188c478f80de3"}
May 28 18:25:52.991525 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.991476    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"c53650f03eb1fb5a7a81214e45fc893fc9fdf113ef4b7a7aa960dfc15852e892"}
May 28 18:25:52.992431 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:52.992411    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4mljd"
May 28 18:25:53.002326 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:53.002264    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g5plz" podStartSLOduration=3.234742089 podStartE2EDuration="24.002252204s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.607369486 +0000 UTC m=+3.226136447" lastFinishedPulling="2026-05-28 18:25:52.374879602 +0000 UTC m=+23.993646562" observedRunningTime="2026-05-28 18:25:53.002072687 +0000 UTC m=+24.620839670" watchObservedRunningTime="2026-05-28 18:25:53.002252204 +0000 UTC m=+24.621019187"
May 28 18:25:54.885865 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.885642    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:54.886672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.885642    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:54.886672 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:54.885962    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:54.886672 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:54.886007    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:54.999132 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.999025    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" event={"ID":"7f546374-21c0-4cba-a4ba-2572c1486cd3","Type":"ContainerStarted","Data":"d29894768d4764ddac169fee0a2b16ec50740d697d0bb8d48f3166619da5fb04"}
May 28 18:25:54.999389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.999358    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:54.999495 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.999391    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:54.999495 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:54.999404    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:55.017380 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:55.017324    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:55.017779 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:55.017747    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:25:55.026398 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:55.026345    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48" podStartSLOduration=7.653295701 podStartE2EDuration="26.026331317s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.603827524 +0000 UTC m=+3.222594485" lastFinishedPulling="2026-05-28 18:25:49.976863127 +0000 UTC m=+21.595630101" observedRunningTime="2026-05-28 18:25:55.025821021 +0000 UTC m=+26.644588004" watchObservedRunningTime="2026-05-28 18:25:55.026331317 +0000 UTC m=+26.645098296"
May 28 18:25:56.590997 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:56.590950    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zhg9"]
May 28 18:25:56.591450 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:56.591103    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:56.591450 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:56.591217    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:56.593706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:56.593459    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmn9f"]
May 28 18:25:56.593706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:56.593599    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:56.593899 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:56.593710    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:57.004719 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:57.004684    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="763265bf3547f5afee6326a90c4b65d10bbdd473af7b86e2f06514f2c116ca6f" exitCode=0
May 28 18:25:57.004888 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:57.004769    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"763265bf3547f5afee6326a90c4b65d10bbdd473af7b86e2f06514f2c116ca6f"}
May 28 18:25:57.885933 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:57.885894    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:57.886454 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:57.886030    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:25:58.886885 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:58.886844    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:25:58.887363 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:58.886959    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:25:59.010964 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:59.010889    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="9f51b3452237c3536a1f27e5370d5b94ea65ef86f01245bc0dac13b269dca73f" exitCode=0
May 28 18:25:59.011082 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:59.010961    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"9f51b3452237c3536a1f27e5370d5b94ea65ef86f01245bc0dac13b269dca73f"}
May 28 18:25:59.886162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:25:59.885988    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:25:59.886305 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:25:59.886244    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:26:00.885832 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:00.885797    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:00.886361 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:00.885920    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8zhg9" podUID="5a347754-cd0e-46c0-97d5-f09cae2c962e"
May 28 18:26:01.016876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.016844    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="098bd939738ff3f1876d99bc6f3c7ae43d960a4e21c4226b47deedb8ea201a83" exitCode=0
May 28 18:26:01.017044 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.016892    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"098bd939738ff3f1876d99bc6f3c7ae43d960a4e21c4226b47deedb8ea201a83"}
May 28 18:26:01.446408 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.446336    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9t5lj"]
May 28 18:26:01.467133 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.467101    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9t5lj"]
May 28 18:26:01.467289 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.467190    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.467289 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:01.467254    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9t5lj" podUID="e0cb9cb1-2497-48d2-8544-7385e27a8468"
May 28 18:26:01.541007 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.540963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.541007 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.541016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-kubelet-config\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.541214 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.541048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-dbus\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.641853 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.641815    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-kubelet-config\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.642048 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.641879    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-dbus\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.642048 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.641956    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.642048 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.641955    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-kubelet-config\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.642167 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:01.642092    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:01.642167 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:01.642150    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret podName:e0cb9cb1-2497-48d2-8544-7385e27a8468 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:02.142135384 +0000 UTC m=+33.760902348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret") pod "global-pull-secret-syncer-9t5lj" (UID: "e0cb9cb1-2497-48d2-8544-7385e27a8468") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:01.642260 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.642192    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e0cb9cb1-2497-48d2-8544-7385e27a8468-dbus\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:01.886335 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:01.886299    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:26:01.886770 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:01.886410    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:26:02.018785 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.018706    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:02.018964 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.018857    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9t5lj" podUID="e0cb9cb1-2497-48d2-8544-7385e27a8468"
May 28 18:26:02.147169 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.147079    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:02.147317 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.147239    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:02.147317 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.147301    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret podName:e0cb9cb1-2497-48d2-8544-7385e27a8468 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.14728606 +0000 UTC m=+34.766053025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret") pod "global-pull-secret-syncer-9t5lj" (UID: "e0cb9cb1-2497-48d2-8544-7385e27a8468") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:02.549638 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.549604    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:26:02.549805 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.549759    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:02.549845 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.549829    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.549810034 +0000 UTC m=+66.168576995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 18:26:02.650298 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.650261    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:02.650499 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.650449    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 18:26:02.650499 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.650472    2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 18:26:02.650499 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.650485    2563 projected.go:194] Error preparing data for projected volume kube-api-access-5vgw9 for pod openshift-network-diagnostics/network-check-target-8zhg9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:02.650670 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.650554    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9 podName:5a347754-cd0e-46c0-97d5-f09cae2c962e nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.650534109 +0000 UTC m=+66.269301072 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5vgw9" (UniqueName: "kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9") pod "network-check-target-8zhg9" (UID: "5a347754-cd0e-46c0-97d5-f09cae2c962e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 18:26:02.726500 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.726415    2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-168.ec2.internal" event="NodeReady"
May 28 18:26:02.726661 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.726585    2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 18:26:02.764692 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.764663    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85f8864fdd-q5mkp"]
May 28 18:26:02.768444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.768423    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"]
May 28 18:26:02.768638 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.768606    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.771797 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.771777    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dtdtx\""
May 28 18:26:02.771896 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.771823    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 18:26:02.772167 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.772150    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"]
May 28 18:26:02.772285 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.772271    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.773543 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.773526    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 18:26:02.773784 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.773766    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 18:26:02.775897 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.775854    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"]
May 28 18:26:02.776151 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.776129    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.776800 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.776509    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 18:26:02.776800 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.776573    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-n4h6z\""
May 28 18:26:02.776800 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.776581    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 18:26:02.777218 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.777201    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 18:26:02.777310 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.777225    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 18:26:02.779484 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.779332    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 18:26:02.779484 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.779335    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2m48c\""
May 28 18:26:02.779484 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.779350    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 18:26:02.779701 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.779619    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"]
May 28 18:26:02.779797 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.779753    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.782008 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.781794    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 18:26:02.782161 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.782143    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 18:26:02.783713 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.783694    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7k75k"]
May 28 18:26:02.783845 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.783828    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.786886 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.786869    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 28 18:26:02.787001 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.786983    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 28 18:26:02.787090 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.787053    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 28 18:26:02.787296 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.787274    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 28 18:26:02.787923 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.787905    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85f8864fdd-q5mkp"]
May 28 18:26:02.788031 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.787931    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"]
May 28 18:26:02.788095 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.788038    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7k75k"
May 28 18:26:02.788159 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.788132    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"]
May 28 18:26:02.793852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.793809    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 18:26:02.793961 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.793891    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\""
May 28 18:26:02.794023 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.793979    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 18:26:02.796317 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.796297    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"]
May 28 18:26:02.797236 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.797213    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"]
May 28 18:26:02.803992 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.803941    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w8dbq"]
May 28 18:26:02.808597 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.808556    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7k75k"]
May 28 18:26:02.808790 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.808759    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:02.811644 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.811626    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 18:26:02.811644 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.811640    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 18:26:02.811792 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.811689    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\""
May 28 18:26:02.812006 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.811990    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 18:26:02.820534 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.820509    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8dbq"]
May 28 18:26:02.851485 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2vdh\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93e2da7-ae62-4e35-90df-e99abd94e20c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851532    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851672 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrqtr\" (UniqueName: \"kubernetes.io/projected/e93e2da7-ae62-4e35-90df-e99abd94e20c-kube-api-access-jrqtr\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851755    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-tmp\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851796    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.851942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t459\" (UniqueName: \"kubernetes.io/projected/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-kube-api-access-7t459\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.852157 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac45cf08-9a72-4348-9ce1-45664931e225-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.852157 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.851980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.886800 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.886766    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:02.889381 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.889356    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:26:02.891004 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.890968    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:26:02.891127 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.891043    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\""
May 28 18:26:02.952472 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.952472 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952473    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac45cf08-9a72-4348-9ce1-45664931e225-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d0cce43-0000-4817-93c7-600083b86f90-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcll\" (UniqueName: \"kubernetes.io/projected/0d0cce43-0000-4817-93c7-600083b86f90-kube-api-access-dzcll\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952610    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952642    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7t459\" (UniqueName: \"kubernetes.io/projected/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-kube-api-access-7t459\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952663    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-tmp\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952684    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952706    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jrqtr\" (UniqueName: \"kubernetes.io/projected/e93e2da7-ae62-4e35-90df-e99abd94e20c-kube-api-access-jrqtr\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.952753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952730    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.953179 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952853    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953179 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.952951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.953179 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-tmp\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.953331 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953198    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.953331 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-config-volume\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:02.953331 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953267    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2vdh\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953331 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.953286    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:02.953522 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.953345    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.453327482 +0000 UTC m=+35.072094455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:02.953522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953368    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ac45cf08-9a72-4348-9ce1-45664931e225-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:02.953522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953286    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93e2da7-ae62-4e35-90df-e99abd94e20c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.953522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmdq9\" (UniqueName: \"kubernetes.io/projected/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-kube-api-access-zmdq9\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:02.953522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953485    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953793 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-tmp-dir\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:02.953793 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953551    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953793 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953627    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953793 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.953793 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbsjv\" (UniqueName: \"kubernetes.io/projected/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-kube-api-access-tbsjv\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953810    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.953915    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.953994    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:02.954028 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.954006    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:02.954234 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:02.954047    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.454032627 +0000 UTC m=+35.072799607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:02.954234 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.954100    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.957121 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.957094    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.957217 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.957128    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e93e2da7-ae62-4e35-90df-e99abd94e20c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.957217 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.957131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.957217 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.957145    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-klusterlet-config\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.967402 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.967378    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t459\" (UniqueName: \"kubernetes.io/projected/0f1aaa25-af64-46e6-a18d-ef5b6215e2f7-kube-api-access-7t459\") pod \"klusterlet-addon-workmgr-74d8544f49-ktcvr\" (UID: \"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:02.967554 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.967529    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrqtr\" (UniqueName: \"kubernetes.io/projected/e93e2da7-ae62-4e35-90df-e99abd94e20c-kube-api-access-jrqtr\") pod \"managed-serviceaccount-addon-agent-5c64df79fb-hj8ts\" (UID: \"e93e2da7-ae62-4e35-90df-e99abd94e20c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:02.967751 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.967731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:02.968678 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:02.968656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2vdh\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:03.054943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.054850    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-tmp-dir\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.054943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.054914    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tbsjv\" (UniqueName: \"kubernetes.io/projected/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-kube-api-access-tbsjv\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.054947    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.054964    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.054982    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055010    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055036    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055057    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d0cce43-0000-4817-93c7-600083b86f90-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055091    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcll\" (UniqueName: \"kubernetes.io/projected/0d0cce43-0000-4817-93c7-600083b86f90-kube-api-access-dzcll\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.055108    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:03.055165 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055146    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.055587 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.055187    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.555160824 +0000 UTC m=+35.173927798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:03.055587 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055250    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-config-volume\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.055587 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-tmp-dir\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.055587 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.055290    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdq9\" (UniqueName: \"kubernetes.io/projected/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-kube-api-access-zmdq9\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:03.055860 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.055690    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:03.055860 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.055751    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:03.55573414 +0000 UTC m=+35.174501107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:03.056384 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.056362    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/0d0cce43-0000-4817-93c7-600083b86f90-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.056955 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.056931    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-config-volume\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.058107 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.058057    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.058107 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.058066    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.058107 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.058068    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-ca\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.058318 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.058257    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0d0cce43-0000-4817-93c7-600083b86f90-hub\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.066753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.066634    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbsjv\" (UniqueName: \"kubernetes.io/projected/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-kube-api-access-tbsjv\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.067247 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.067224    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdq9\" (UniqueName: \"kubernetes.io/projected/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-kube-api-access-zmdq9\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:03.067373 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.067356    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcll\" (UniqueName: \"kubernetes.io/projected/0d0cce43-0000-4817-93c7-600083b86f90-kube-api-access-dzcll\") pod \"cluster-proxy-proxy-agent-7fdb9fddd4-vftlp\" (UID: \"0d0cce43-0000-4817-93c7-600083b86f90\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.096613 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.096573    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"
May 28 18:26:03.113685 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.113650    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:03.119448 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.119408    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:26:03.156055 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.155975    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:03.156240 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.156217    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 18:26:03.156357 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.156304    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret podName:e0cb9cb1-2497-48d2-8544-7385e27a8468 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:05.15628455 +0000 UTC m=+36.775051525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret") pod "global-pull-secret-syncer-9t5lj" (UID: "e0cb9cb1-2497-48d2-8544-7385e27a8468") : object "kube-system"/"original-pull-secret" not registered
May 28 18:26:03.272819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.272508    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts"]
May 28 18:26:03.275702 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.275672    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"]
May 28 18:26:03.276954 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:26:03.276914    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode93e2da7_ae62_4e35_90df_e99abd94e20c.slice/crio-7a7b8cb81e95e8aa48e02545ed579baec9fd5c3f2b28fe46669e72efbfcdd0d9 WatchSource:0}: Error finding container 7a7b8cb81e95e8aa48e02545ed579baec9fd5c3f2b28fe46669e72efbfcdd0d9: Status 404 returned error can't find the container with id 7a7b8cb81e95e8aa48e02545ed579baec9fd5c3f2b28fe46669e72efbfcdd0d9
May 28 18:26:03.279540 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:26:03.279512    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d0cce43_0000_4817_93c7_600083b86f90.slice/crio-42d0aa7b69076cfe927774d0b8b6c55e225d75d8cb52a5746158c66185d681da WatchSource:0}: Error finding container 42d0aa7b69076cfe927774d0b8b6c55e225d75d8cb52a5746158c66185d681da: Status 404 returned error can't find the container with id 42d0aa7b69076cfe927774d0b8b6c55e225d75d8cb52a5746158c66185d681da
May 28 18:26:03.288039 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.287990    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"]
May 28 18:26:03.293246 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:26:03.293220    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1aaa25_af64_46e6_a18d_ef5b6215e2f7.slice/crio-704c7abf71ca347481a45ae9a62a62107e60d68d62e6c9fdace5c028c66ec170 WatchSource:0}: Error finding container 704c7abf71ca347481a45ae9a62a62107e60d68d62e6c9fdace5c028c66ec170: Status 404 returned error can't find the container with id 704c7abf71ca347481a45ae9a62a62107e60d68d62e6c9fdace5c028c66ec170
May 28 18:26:03.459446 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.459414    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:03.459628 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.459480    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:03.459628 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.459583    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:03.459628 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.459615    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:03.459628 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.459625    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:03.459754 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.459656    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.45963847 +0000 UTC m=+36.078405436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:03.459754 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.459669    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.45966343 +0000 UTC m=+36.078430391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:03.560613 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.560553    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:03.560753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.560626    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:03.560753 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.560735    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:03.560842 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.560784    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:03.560842 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.560812    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.560790885 +0000 UTC m=+36.179557859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:03.560911 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:03.560843    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:04.560826232 +0000 UTC m=+36.179593208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:03.886736 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.886689    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:26:03.886912 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.886689    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:03.889365 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.889342    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:26:03.889540 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.889527    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 18:26:03.889731 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:03.889717    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\""
May 28 18:26:04.024415 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.024375    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" event={"ID":"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7","Type":"ContainerStarted","Data":"704c7abf71ca347481a45ae9a62a62107e60d68d62e6c9fdace5c028c66ec170"}
May 28 18:26:04.025958 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.025929    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerStarted","Data":"42d0aa7b69076cfe927774d0b8b6c55e225d75d8cb52a5746158c66185d681da"}
May 28 18:26:04.027088 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.027062    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts" event={"ID":"e93e2da7-ae62-4e35-90df-e99abd94e20c","Type":"ContainerStarted","Data":"7a7b8cb81e95e8aa48e02545ed579baec9fd5c3f2b28fe46669e72efbfcdd0d9"}
May 28 18:26:04.470706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.469678    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:04.470706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.469905    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:04.470706 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.470227    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:04.470706 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.470244    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:04.470706 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.470313    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.470291037 +0000 UTC m=+38.089058004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:04.471354 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.471271    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:04.471354 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.471336    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.471319651 +0000 UTC m=+38.090086616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:04.570801 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.570760    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:04.571015 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:04.570820    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:04.571079 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.571046    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:04.571146 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.571109    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.57108933 +0000 UTC m=+38.189856298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:04.571653 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.571515    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:04.571653 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:04.571579    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:06.571549148 +0000 UTC m=+38.190316112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:05.178396 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:05.178351    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:05.192518 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:05.192225    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e0cb9cb1-2497-48d2-8544-7385e27a8468-original-pull-secret\") pod \"global-pull-secret-syncer-9t5lj\" (UID: \"e0cb9cb1-2497-48d2-8544-7385e27a8468\") " pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:05.409381 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:05.408961    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9t5lj"
May 28 18:26:06.494424 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:06.494320    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:06.494450    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.494467    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.494492    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.494555    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.494535669 +0000 UTC m=+42.113302649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.494576    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:06.494819 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.494628    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.494612077 +0000 UTC m=+42.113379042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:06.594926 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:06.594884    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:06.595099 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:06.595025    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:06.595164 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.595151    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:06.595221 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.595213    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.595193734 +0000 UTC m=+42.213960702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:06.595685 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.595608    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:06.595685 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:06.595654    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:10.595641477 +0000 UTC m=+42.214408442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:10.523250 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:10.523196    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:10.523348    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.523378    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.523405    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.523465    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.523469    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.523446677 +0000 UTC m=+50.142213639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:10.523781 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.523538    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.523522231 +0000 UTC m=+50.142289194 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:10.624623 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:10.624581    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:10.624806 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:10.624635    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:10.624806 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.624739    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:10.624806 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.624745    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:10.624806 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.624796    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.624780933 +0000 UTC m=+50.243547893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:10.624973 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:10.624815    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:18.62480622 +0000 UTC m=+50.243573183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:13.544019 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:13.543980    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9t5lj"]
May 28 18:26:13.549775 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:26:13.549747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0cb9cb1_2497_48d2_8544_7385e27a8468.slice/crio-9e9e0231060c342bfe3d8f81a6750166b130d7c22beebcf1928fed4d422c8be8 WatchSource:0}: Error finding container 9e9e0231060c342bfe3d8f81a6750166b130d7c22beebcf1928fed4d422c8be8: Status 404 returned error can't find the container with id 9e9e0231060c342bfe3d8f81a6750166b130d7c22beebcf1928fed4d422c8be8
May 28 18:26:14.052960 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.052863    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" event={"ID":"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7","Type":"ContainerStarted","Data":"6dd2c6fdab007ee4c11ac913b18dbe94f72a2511400d6f00af19de39cb52657b"}
May 28 18:26:14.053146 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.053050    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:14.053909 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.053886    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9t5lj" event={"ID":"e0cb9cb1-2497-48d2-8544-7385e27a8468","Type":"ContainerStarted","Data":"9e9e0231060c342bfe3d8f81a6750166b130d7c22beebcf1928fed4d422c8be8"}
May 28 18:26:14.055065 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.055042    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:26:14.055300 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.055255    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts" event={"ID":"e93e2da7-ae62-4e35-90df-e99abd94e20c","Type":"ContainerStarted","Data":"1824f2cb24b9bcc4cb110dee6f8f7cb098554fb0e1ec2d5d459cfd8a10286f88"}
May 28 18:26:14.056461 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.056442    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerStarted","Data":"285a9e38ed767359f7dcbe20faa76a78ae04da8af1caa4bb20a214a2317aa0fb"}
May 28 18:26:14.058524 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.058503    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="1c8cfa48622d3b515d2ba9bcecaa726ccd5aa8cf2b550fc11a45226f352235ca" exitCode=0
May 28 18:26:14.058614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.058534    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"1c8cfa48622d3b515d2ba9bcecaa726ccd5aa8cf2b550fc11a45226f352235ca"}
May 28 18:26:14.073396 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.073358    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" podStartSLOduration=30.948582176 podStartE2EDuration="41.073347696s" podCreationTimestamp="2026-05-28 18:25:33 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.295490932 +0000 UTC m=+34.914257899" lastFinishedPulling="2026-05-28 18:26:13.42025645 +0000 UTC m=+45.039023419" observedRunningTime="2026-05-28 18:26:14.072597099 +0000 UTC m=+45.691364081" watchObservedRunningTime="2026-05-28 18:26:14.073347696 +0000 UTC m=+45.692114679"
May 28 18:26:14.101300 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:14.101261    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts" podStartSLOduration=30.952387939 podStartE2EDuration="41.101243293s" podCreationTimestamp="2026-05-28 18:25:33 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.279003208 +0000 UTC m=+34.897770174" lastFinishedPulling="2026-05-28 18:26:13.427858563 +0000 UTC m=+45.046625528" observedRunningTime="2026-05-28 18:26:14.100089901 +0000 UTC m=+45.718856885" watchObservedRunningTime="2026-05-28 18:26:14.101243293 +0000 UTC m=+45.720010276"
May 28 18:26:15.064522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:15.064486    2563 generic.go:358] "Generic (PLEG): container finished" podID="f3cde208-3b7f-4b2d-88f2-d0390cdb5c35" containerID="228b5c119aedfb0cfa574ca51d0a4a7fce7dec4523ce9404a3e04be7dd567a1d" exitCode=0
May 28 18:26:15.064979 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:15.064528    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerDied","Data":"228b5c119aedfb0cfa574ca51d0a4a7fce7dec4523ce9404a3e04be7dd567a1d"}
May 28 18:26:16.070356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:16.070315    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" event={"ID":"f3cde208-3b7f-4b2d-88f2-d0390cdb5c35","Type":"ContainerStarted","Data":"ad49c12829ee68768ac09aef742eaac6c13b8aba4a428d6a7a3a40fa7033e5e1"}
May 28 18:26:16.093711 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:16.093648    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mzpzd" podStartSLOduration=5.284192923 podStartE2EDuration="47.093628099s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:25:31.611540189 +0000 UTC m=+3.230307150" lastFinishedPulling="2026-05-28 18:26:13.420975363 +0000 UTC m=+45.039742326" observedRunningTime="2026-05-28 18:26:16.092387191 +0000 UTC m=+47.711154201" watchObservedRunningTime="2026-05-28 18:26:16.093628099 +0000 UTC m=+47.712395083"
May 28 18:26:18.593352 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:18.593308    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:18.593373    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.593475    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.593477    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.593593    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.593582    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.593545727 +0000 UTC m=+66.212312688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:18.593730 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.593652    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.593639089 +0000 UTC m=+66.212406054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:18.694045 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:18.694004    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:18.694045 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:18.694046    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:18.694237 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.694147    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:18.694237 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.694208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.694193746 +0000 UTC m=+66.312960707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:18.694237 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.694157    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:18.694237 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:18.694238    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:26:34.694232587 +0000 UTC m=+66.312999547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:19.078539 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:19.078497    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9t5lj" event={"ID":"e0cb9cb1-2497-48d2-8544-7385e27a8468","Type":"ContainerStarted","Data":"f9c83a1e0b7ea56198c7f9a376fac0036debe7ca98d868f8ade7994774deae86"}
May 28 18:26:19.080281 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:19.080257    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerStarted","Data":"06edb12a3891734bf637099b432852c2810db7a6ceb1616ac17595337df3d3a6"}
May 28 18:26:19.080389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:19.080288    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerStarted","Data":"e75f122cc77f5bfcf74e0f81dffe9e72ee3e5835d3e25150b1b6a0a1a388b73b"}
May 28 18:26:19.093841 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:19.093787    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9t5lj" podStartSLOduration=12.914977115 podStartE2EDuration="18.093774395s" podCreationTimestamp="2026-05-28 18:26:01 +0000 UTC" firstStartedPulling="2026-05-28 18:26:13.552227001 +0000 UTC m=+45.170993962" lastFinishedPulling="2026-05-28 18:26:18.731024281 +0000 UTC m=+50.349791242" observedRunningTime="2026-05-28 18:26:19.093293625 +0000 UTC m=+50.712060608" watchObservedRunningTime="2026-05-28 18:26:19.093774395 +0000 UTC m=+50.712541377"
May 28 18:26:19.112604 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:19.112483    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" podStartSLOduration=30.673628888 podStartE2EDuration="46.112442646s" podCreationTimestamp="2026-05-28 18:25:33 +0000 UTC" firstStartedPulling="2026-05-28 18:26:03.281007881 +0000 UTC m=+34.899774855" lastFinishedPulling="2026-05-28 18:26:18.719821649 +0000 UTC m=+50.338588613" observedRunningTime="2026-05-28 18:26:19.110597726 +0000 UTC m=+50.729364709" watchObservedRunningTime="2026-05-28 18:26:19.112442646 +0000 UTC m=+50.731209631"
May 28 18:26:27.016201 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:27.016175    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bqb48"
May 28 18:26:34.614108 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.614067    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:26:34.614108 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.614111    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.614146    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.614233    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.614247    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.614292    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.614304    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.614290577 +0000 UTC m=+98.233057538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:26:34.614590 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.614379    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.61436091 +0000 UTC m=+98.233127952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:26:34.616733 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.616716    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 18:26:34.624639 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.624619    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:26:34.624695 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.624665    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:38.624653077 +0000 UTC m=+130.243420037 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : secret "metrics-daemon-secret" not found
May 28 18:26:34.714595 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.714543    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:26:34.714705 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.714665    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:34.714705 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.714693    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:26:34.714799 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.714695    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:26:34.714799 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.714758    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.714743655 +0000 UTC m=+98.333510616 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:26:34.714799 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.714785    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:26:34.714944 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:26:34.714867    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:27:06.714853619 +0000 UTC m=+98.333620581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:26:34.716967 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.716951    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 18:26:34.726914 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.726881    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 18:26:34.738065 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:34.738044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vgw9\" (UniqueName: \"kubernetes.io/projected/5a347754-cd0e-46c0-97d5-f09cae2c962e-kube-api-access-5vgw9\") pod \"network-check-target-8zhg9\" (UID: \"5a347754-cd0e-46c0-97d5-f09cae2c962e\") " pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:35.000344 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:35.000258    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7rmft\""
May 28 18:26:35.008345 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:35.008320    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:35.126150 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:35.126118    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8zhg9"]
May 28 18:26:35.128966 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:26:35.128941    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a347754_cd0e_46c0_97d5_f09cae2c962e.slice/crio-841138cb147321ed49457b080cc5898cae0e090f4b9d8d3ffa0cdf97f5cd42c9 WatchSource:0}: Error finding container 841138cb147321ed49457b080cc5898cae0e090f4b9d8d3ffa0cdf97f5cd42c9: Status 404 returned error can't find the container with id 841138cb147321ed49457b080cc5898cae0e090f4b9d8d3ffa0cdf97f5cd42c9
May 28 18:26:36.123531 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:36.123494    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zhg9" event={"ID":"5a347754-cd0e-46c0-97d5-f09cae2c962e","Type":"ContainerStarted","Data":"841138cb147321ed49457b080cc5898cae0e090f4b9d8d3ffa0cdf97f5cd42c9"}
May 28 18:26:39.131781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:39.131748    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8zhg9" event={"ID":"5a347754-cd0e-46c0-97d5-f09cae2c962e","Type":"ContainerStarted","Data":"b855c797a7aa837c38bdea75f06e4f0358ef73008409c6a2193578f8153c5427"}
May 28 18:26:39.132170 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:39.131873    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:26:39.147684 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:26:39.147643    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8zhg9" podStartSLOduration=66.566128679 podStartE2EDuration="1m10.147630141s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:26:35.130625668 +0000 UTC m=+66.749392628" lastFinishedPulling="2026-05-28 18:26:38.712127126 +0000 UTC m=+70.330894090" observedRunningTime="2026-05-28 18:26:39.146724703 +0000 UTC m=+70.765491687" watchObservedRunningTime="2026-05-28 18:26:39.147630141 +0000 UTC m=+70.766397120"
May 28 18:27:06.668168 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:06.668129    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:06.668224    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.668286    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.668305    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.668330    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.668386    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:10.66834766 +0000 UTC m=+162.287114621 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:27:06.668583 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.668400    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:10.668394008 +0000 UTC m=+162.287160969 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:27:06.769597 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:06.769542    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:27:06.769767 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:06.769602    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:27:06.769767 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.769701    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 18:27:06.769767 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.769761    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls podName:6d23005a-e9cd-491b-9b06-a93fe60cb0bc nodeName:}" failed. No retries permitted until 2026-05-28 18:28:10.769745564 +0000 UTC m=+162.388512530 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls") pod "dns-default-7k75k" (UID: "6d23005a-e9cd-491b-9b06-a93fe60cb0bc") : secret "dns-default-metrics-tls" not found
May 28 18:27:06.769923 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.769701    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:27:06.769923 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:06.769855    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:28:10.769836134 +0000 UTC m=+162.388603115 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:27:10.139521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:10.139489    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8zhg9"
May 28 18:27:38.710968 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:27:38.710923    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:27:38.711449 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:38.711050    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 18:27:38.711449 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:27:38.711107    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs podName:2953c6b4-0ac6-4448-b422-f72618caf8b3 nodeName:}" failed. No retries permitted until 2026-05-28 18:29:40.711092473 +0000 UTC m=+252.329859433 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs") pod "network-metrics-daemon-xmn9f" (UID: "2953c6b4-0ac6-4448-b422-f72618caf8b3") : secret "metrics-daemon-secret" not found
May 28 18:28:03.993105 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:03.993077    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zzxvm_5a7baa17-0558-4e1b-8905-a03070dc5514/dns-node-resolver/0.log"
May 28 18:28:04.593072 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:04.593044    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6m2zp_be20f7e5-caed-4be7-a16e-7006ca321b07/node-ca/0.log"
May 28 18:28:05.779750 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:05.779707    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp" podUID="49348da1-21a8-42af-a181-70f394f37714"
May 28 18:28:05.804513 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:05.804469    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8" podUID="ac45cf08-9a72-4348-9ce1-45664931e225"
May 28 18:28:05.835739 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:05.835708    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7k75k" podUID="6d23005a-e9cd-491b-9b06-a93fe60cb0bc"
May 28 18:28:05.840863 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:05.840836    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-w8dbq" podUID="991b67c7-ef9c-4fde-bf3f-601c61ecbbd3"
May 28 18:28:06.332671 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:06.332641    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:28:06.332835 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:06.332690    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:28:06.332835 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:06.332739    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7k75k"
May 28 18:28:06.332920 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:06.332836    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:28:06.901817 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:06.901782    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xmn9f" podUID="2953c6b4-0ac6-4448-b422-f72618caf8b3"
May 28 18:28:10.757789 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:10.757744    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:10.757801    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") pod \"image-registry-85f8864fdd-q5mkp\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") " pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.757883    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.757905    2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.757915    2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85f8864fdd-q5mkp: secret "image-registry-tls" not found
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.757960    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert podName:ac45cf08-9a72-4348-9ce1-45664931e225 nodeName:}" failed. No retries permitted until 2026-05-28 18:30:12.757941933 +0000 UTC m=+284.376708893 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-7vbl8" (UID: "ac45cf08-9a72-4348-9ce1-45664931e225") : secret "networking-console-plugin-cert" not found
May 28 18:28:10.758265 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.757974    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls podName:49348da1-21a8-42af-a181-70f394f37714 nodeName:}" failed. No retries permitted until 2026-05-28 18:30:12.757967934 +0000 UTC m=+284.376734895 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls") pod "image-registry-85f8864fdd-q5mkp" (UID: "49348da1-21a8-42af-a181-70f394f37714") : secret "image-registry-tls" not found
May 28 18:28:10.858555 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:10.858515    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:28:10.858754 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.858658    2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 18:28:10.858754 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:10.858721    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert podName:991b67c7-ef9c-4fde-bf3f-601c61ecbbd3 nodeName:}" failed. No retries permitted until 2026-05-28 18:30:12.858704459 +0000 UTC m=+284.477471437 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert") pod "ingress-canary-w8dbq" (UID: "991b67c7-ef9c-4fde-bf3f-601c61ecbbd3") : secret "canary-serving-cert" not found
May 28 18:28:10.858754 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:10.858664    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:28:10.860865 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:10.860843    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d23005a-e9cd-491b-9b06-a93fe60cb0bc-metrics-tls\") pod \"dns-default-7k75k\" (UID: \"6d23005a-e9cd-491b-9b06-a93fe60cb0bc\") " pod="openshift-dns/dns-default-7k75k"
May 28 18:28:11.135953 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:11.135925    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bpf94\""
May 28 18:28:11.144717 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:11.144682    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7k75k"
May 28 18:28:11.266686 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:11.266656    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7k75k"]
May 28 18:28:11.269662 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:28:11.269628    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d23005a_e9cd_491b_9b06_a93fe60cb0bc.slice/crio-fb55534c4883384bc7a406cde4adf15789c127d460046afceaa27d01b3f90c0d WatchSource:0}: Error finding container fb55534c4883384bc7a406cde4adf15789c127d460046afceaa27d01b3f90c0d: Status 404 returned error can't find the container with id fb55534c4883384bc7a406cde4adf15789c127d460046afceaa27d01b3f90c0d
May 28 18:28:11.345205 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:11.345168    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k75k" event={"ID":"6d23005a-e9cd-491b-9b06-a93fe60cb0bc","Type":"ContainerStarted","Data":"fb55534c4883384bc7a406cde4adf15789c127d460046afceaa27d01b3f90c0d"}
May 28 18:28:13.351629 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:13.351596    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k75k" event={"ID":"6d23005a-e9cd-491b-9b06-a93fe60cb0bc","Type":"ContainerStarted","Data":"6d61a98ed55fcf23247f674ec0c4d9267ae0d03f67920a978dc810447cca4354"}
May 28 18:28:13.351629 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:13.351632    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7k75k" event={"ID":"6d23005a-e9cd-491b-9b06-a93fe60cb0bc","Type":"ContainerStarted","Data":"14cb47ad7c9ff893aa360aa9fb117e59b121f2d1c6a9538a0dc7e245bd14f4f6"}
May 28 18:28:13.352055 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:13.351810    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7k75k"
May 28 18:28:13.370431 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:13.370382    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-7k75k" podStartSLOduration=129.787975695 podStartE2EDuration="2m11.370369671s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:28:11.271328552 +0000 UTC m=+162.890095513" lastFinishedPulling="2026-05-28 18:28:12.853722528 +0000 UTC m=+164.472489489" observedRunningTime="2026-05-28 18:28:13.369660341 +0000 UTC m=+164.988427325" watchObservedRunningTime="2026-05-28 18:28:13.370369671 +0000 UTC m=+164.989136654"
May 28 18:28:14.054307 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.054210    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" podUID="0f1aaa25-af64-46e6-a18d-ef5b6215e2f7" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused"
May 28 18:28:14.354735 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.354703    2563 generic.go:358] "Generic (PLEG): container finished" podID="0f1aaa25-af64-46e6-a18d-ef5b6215e2f7" containerID="6dd2c6fdab007ee4c11ac913b18dbe94f72a2511400d6f00af19de39cb52657b" exitCode=1
May 28 18:28:14.355120 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.354775    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" event={"ID":"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7","Type":"ContainerDied","Data":"6dd2c6fdab007ee4c11ac913b18dbe94f72a2511400d6f00af19de39cb52657b"}
May 28 18:28:14.355181 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.355131    2563 scope.go:117] "RemoveContainer" containerID="6dd2c6fdab007ee4c11ac913b18dbe94f72a2511400d6f00af19de39cb52657b"
May 28 18:28:14.356000 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.355980    2563 generic.go:358] "Generic (PLEG): container finished" podID="e93e2da7-ae62-4e35-90df-e99abd94e20c" containerID="1824f2cb24b9bcc4cb110dee6f8f7cb098554fb0e1ec2d5d459cfd8a10286f88" exitCode=255
May 28 18:28:14.356060 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.356016    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts" event={"ID":"e93e2da7-ae62-4e35-90df-e99abd94e20c","Type":"ContainerDied","Data":"1824f2cb24b9bcc4cb110dee6f8f7cb098554fb0e1ec2d5d459cfd8a10286f88"}
May 28 18:28:14.356553 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:14.356447    2563 scope.go:117] "RemoveContainer" containerID="1824f2cb24b9bcc4cb110dee6f8f7cb098554fb0e1ec2d5d459cfd8a10286f88"
May 28 18:28:15.360830 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:15.360799    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c64df79fb-hj8ts" event={"ID":"e93e2da7-ae62-4e35-90df-e99abd94e20c","Type":"ContainerStarted","Data":"d9430aefe30cf971b85b73ce30fafbfd96cc2dc513901be614fb4b406ce02bc5"}
May 28 18:28:15.362201 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:15.362180    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr" event={"ID":"0f1aaa25-af64-46e6-a18d-ef5b6215e2f7","Type":"ContainerStarted","Data":"ec6d38a6c77cf34cc10c56922d732e9b29ed6a070f9d5fdf97e51abd0b3a8b2b"}
May 28 18:28:15.362442 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:15.362426    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:28:15.363081 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:15.363064    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74d8544f49-ktcvr"
May 28 18:28:17.885873 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:17.885839    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:28:23.358223 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:23.358193    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7k75k"
May 28 18:28:25.597886 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.597852    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-48xlx"]
May 28 18:28:25.599791 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.599776    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.602924 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.602902    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 18:28:25.603399 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.603374    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 18:28:25.603522 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.603505    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 18:28:25.604110 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.604089    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 18:28:25.604184 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.604089    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w6q6\""
May 28 18:28:25.628725 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.628696    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48xlx"]
May 28 18:28:25.771860 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.771823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba583c62-23b7-4271-a098-0d79ed192279-crio-socket\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.771860 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.771861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2scdq\" (UniqueName: \"kubernetes.io/projected/ba583c62-23b7-4271-a098-0d79ed192279-kube-api-access-2scdq\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.772058 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.771886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba583c62-23b7-4271-a098-0d79ed192279-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.772058 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.771986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba583c62-23b7-4271-a098-0d79ed192279-data-volume\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.772058 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.772043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba583c62-23b7-4271-a098-0d79ed192279-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873100 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873021    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba583c62-23b7-4271-a098-0d79ed192279-crio-socket\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873100 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873059    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2scdq\" (UniqueName: \"kubernetes.io/projected/ba583c62-23b7-4271-a098-0d79ed192279-kube-api-access-2scdq\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873100 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873084    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba583c62-23b7-4271-a098-0d79ed192279-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873313 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873136    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba583c62-23b7-4271-a098-0d79ed192279-data-volume\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873313 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873141    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba583c62-23b7-4271-a098-0d79ed192279-crio-socket\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873313 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873182    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba583c62-23b7-4271-a098-0d79ed192279-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873590 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba583c62-23b7-4271-a098-0d79ed192279-data-volume\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.873688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.873673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba583c62-23b7-4271-a098-0d79ed192279-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.875449 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.875432    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba583c62-23b7-4271-a098-0d79ed192279-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.882216 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.882194    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2scdq\" (UniqueName: \"kubernetes.io/projected/ba583c62-23b7-4271-a098-0d79ed192279-kube-api-access-2scdq\") pod \"insights-runtime-extractor-48xlx\" (UID: \"ba583c62-23b7-4271-a098-0d79ed192279\") " pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:25.909332 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:25.909306    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-48xlx"
May 28 18:28:26.033623 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:26.033590    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-48xlx"]
May 28 18:28:26.036371 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:28:26.036337    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba583c62_23b7_4271_a098_0d79ed192279.slice/crio-2f53aacabad5e0db5f20ba631229a88ea278d602ef050fe9f71193910fd86f0c WatchSource:0}: Error finding container 2f53aacabad5e0db5f20ba631229a88ea278d602ef050fe9f71193910fd86f0c: Status 404 returned error can't find the container with id 2f53aacabad5e0db5f20ba631229a88ea278d602ef050fe9f71193910fd86f0c
May 28 18:28:26.391854 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:26.391817    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xlx" event={"ID":"ba583c62-23b7-4271-a098-0d79ed192279","Type":"ContainerStarted","Data":"8aaefa3b19126a25e1e41a4414df0b35d57470c192a39593fda98c489efa7c83"}
May 28 18:28:26.391854 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:26.391856    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xlx" event={"ID":"ba583c62-23b7-4271-a098-0d79ed192279","Type":"ContainerStarted","Data":"2f53aacabad5e0db5f20ba631229a88ea278d602ef050fe9f71193910fd86f0c"}
May 28 18:28:27.396157 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:27.396125    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xlx" event={"ID":"ba583c62-23b7-4271-a098-0d79ed192279","Type":"ContainerStarted","Data":"2a2735df6483b5cda6648e53f59049ff1c6a3362b12170394e026a2a6602525d"}
May 28 18:28:28.402075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:28.402034    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-48xlx" event={"ID":"ba583c62-23b7-4271-a098-0d79ed192279","Type":"ContainerStarted","Data":"692f0a4f274eac5dde21ff67d5eb8e4b36638b1402f79cea70b2ed05225cb170"}
May 28 18:28:28.432273 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:28.432223    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-48xlx" podStartSLOduration=1.239925943 podStartE2EDuration="3.432208297s" podCreationTimestamp="2026-05-28 18:28:25 +0000 UTC" firstStartedPulling="2026-05-28 18:28:26.086891836 +0000 UTC m=+177.705658797" lastFinishedPulling="2026-05-28 18:28:28.279174186 +0000 UTC m=+179.897941151" observedRunningTime="2026-05-28 18:28:28.430522631 +0000 UTC m=+180.049289857" watchObservedRunningTime="2026-05-28 18:28:28.432208297 +0000 UTC m=+180.050975305"
May 28 18:28:37.959468 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.959437    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ql2zz"]
May 28 18:28:37.961536 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.961522    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.964313 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.964293    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 18:28:37.964998 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.964979    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 18:28:37.969075 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-textfile\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969153 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-sys\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969153 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-root\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969219 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969192    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969253 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-tls\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969317 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-metrics-client-ca\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969317 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlq26\" (UniqueName: \"kubernetes.io/projected/cb046df9-0f78-49ab-838c-dfbe6146fb3a-kube-api-access-nlq26\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969387 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969387 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969370    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-wtmp\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:37.969444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969408    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 18:28:37.969696 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.969683    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 18:28:37.972059 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.972045    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 18:28:37.980141 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.980122    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dfg6h\""
May 28 18:28:37.980979 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:37.980966    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 18:28:38.069682 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069644    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-metrics-client-ca\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069682 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069687    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlq26\" (UniqueName: \"kubernetes.io/projected/cb046df9-0f78-49ab-838c-dfbe6146fb3a-kube-api-access-nlq26\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069708    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069740    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-wtmp\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069775    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-textfile\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069799    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-sys\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069815    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-root\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069834    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069861    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-tls\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.069942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069896    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-sys\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.070231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069943    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-wtmp\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.070231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.069961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cb046df9-0f78-49ab-838c-dfbe6146fb3a-root\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.070231 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.070140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-textfile\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.070333 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.070280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-metrics-client-ca\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.070423 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.070404    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-accelerators-collector-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.072134 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.072106    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.072134 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.072131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cb046df9-0f78-49ab-838c-dfbe6146fb3a-node-exporter-tls\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.079755 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.079731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlq26\" (UniqueName: \"kubernetes.io/projected/cb046df9-0f78-49ab-838c-dfbe6146fb3a-kube-api-access-nlq26\") pod \"node-exporter-ql2zz\" (UID: \"cb046df9-0f78-49ab-838c-dfbe6146fb3a\") " pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.270284 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.270205    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ql2zz"
May 28 18:28:38.277826 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:28:38.277799    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb046df9_0f78_49ab_838c_dfbe6146fb3a.slice/crio-80a5493cd47c16fb4571d013cd3f39b25858a6b8691423aa4e5b43c8787ec647 WatchSource:0}: Error finding container 80a5493cd47c16fb4571d013cd3f39b25858a6b8691423aa4e5b43c8787ec647: Status 404 returned error can't find the container with id 80a5493cd47c16fb4571d013cd3f39b25858a6b8691423aa4e5b43c8787ec647
May 28 18:28:38.427639 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:38.427604    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql2zz" event={"ID":"cb046df9-0f78-49ab-838c-dfbe6146fb3a","Type":"ContainerStarted","Data":"80a5493cd47c16fb4571d013cd3f39b25858a6b8691423aa4e5b43c8787ec647"}
May 28 18:28:39.431246 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:39.431210    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql2zz" event={"ID":"cb046df9-0f78-49ab-838c-dfbe6146fb3a","Type":"ContainerStarted","Data":"4235eb6af7aa84e227b65de1648a3629145c18c08ae449d89272b712d8035993"}
May 28 18:28:40.435343 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:40.435297    2563 generic.go:358] "Generic (PLEG): container finished" podID="cb046df9-0f78-49ab-838c-dfbe6146fb3a" containerID="4235eb6af7aa84e227b65de1648a3629145c18c08ae449d89272b712d8035993" exitCode=0
May 28 18:28:40.435712 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:40.435373    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql2zz" event={"ID":"cb046df9-0f78-49ab-838c-dfbe6146fb3a","Type":"ContainerDied","Data":"4235eb6af7aa84e227b65de1648a3629145c18c08ae449d89272b712d8035993"}
May 28 18:28:41.439904 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:41.439873    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql2zz" event={"ID":"cb046df9-0f78-49ab-838c-dfbe6146fb3a","Type":"ContainerStarted","Data":"8ac9f11149ba3304bf8fefa81420386cbe27c1873d74c4bc32ee7b5baed21d7a"}
May 28 18:28:41.439904 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:41.439908    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ql2zz" event={"ID":"cb046df9-0f78-49ab-838c-dfbe6146fb3a","Type":"ContainerStarted","Data":"f51ad39b886f841b2df971e371e549133c2fc0fbb399f07a452df27f88a2894c"}
May 28 18:28:41.470585 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:41.470514    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ql2zz" podStartSLOduration=3.387805123 podStartE2EDuration="4.470498885s" podCreationTimestamp="2026-05-28 18:28:37 +0000 UTC" firstStartedPulling="2026-05-28 18:28:38.279556545 +0000 UTC m=+189.898323507" lastFinishedPulling="2026-05-28 18:28:39.362250309 +0000 UTC m=+190.981017269" observedRunningTime="2026-05-28 18:28:41.469145106 +0000 UTC m=+193.087912103" watchObservedRunningTime="2026-05-28 18:28:41.470498885 +0000 UTC m=+193.089265868"
May 28 18:28:47.439481 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.439434    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f8864fdd-q5mkp"]
May 28 18:28:47.439853 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:28:47.439634    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp" podUID="49348da1-21a8-42af-a181-70f394f37714"
May 28 18:28:47.457243 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.457213    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:28:47.461354 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.461334    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:28:47.550483 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550453    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550495    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550528    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550579    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550604    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2vdh\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550632    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.550680 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.550662    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token\") pod \"49348da1-21a8-42af-a181-70f394f37714\" (UID: \"49348da1-21a8-42af-a181-70f394f37714\") "
May 28 18:28:47.551308 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.551282    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:28:47.551766 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.551745    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:28:47.552903 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.552873    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 18:28:47.552997 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.552905    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:28:47.552997 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.552958    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:28:47.553144 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.553122    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh" (OuterVolumeSpecName: "kube-api-access-t2vdh") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "kube-api-access-t2vdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:28:47.553230 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.553172    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49348da1-21a8-42af-a181-70f394f37714" (UID: "49348da1-21a8-42af-a181-70f394f37714"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:28:47.651772 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651733    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-trusted-ca\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651772 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651765    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-bound-sa-token\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651772 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651776    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-installation-pull-secrets\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651982 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651785    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49348da1-21a8-42af-a181-70f394f37714-registry-certificates\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651982 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651794    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49348da1-21a8-42af-a181-70f394f37714-ca-trust-extracted\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651982 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651805    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49348da1-21a8-42af-a181-70f394f37714-image-registry-private-configuration\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:47.651982 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:47.651817    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2vdh\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-kube-api-access-t2vdh\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:48.460798 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:48.460033    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85f8864fdd-q5mkp"
May 28 18:28:48.496817 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:48.496784    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85f8864fdd-q5mkp"]
May 28 18:28:48.500273 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:48.500250    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85f8864fdd-q5mkp"]
May 28 18:28:48.559224 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:48.559183    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49348da1-21a8-42af-a181-70f394f37714-registry-tls\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:28:48.894584 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:28:48.894534    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49348da1-21a8-42af-a181-70f394f37714" path="/var/lib/kubelet/pods/49348da1-21a8-42af-a181-70f394f37714/volumes"
May 28 18:29:13.121066 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:13.121024    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" podUID="0d0cce43-0000-4817-93c7-600083b86f90" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:29:23.121514 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:23.121469    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" podUID="0d0cce43-0000-4817-93c7-600083b86f90" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:29:33.121162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.121123    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" podUID="0d0cce43-0000-4817-93c7-600083b86f90" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 18:29:33.121651 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.121189    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp"
May 28 18:29:33.121721 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.121656    2563 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"06edb12a3891734bf637099b432852c2810db7a6ceb1616ac17595337df3d3a6"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 28 18:29:33.121767 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.121718    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" podUID="0d0cce43-0000-4817-93c7-600083b86f90" containerName="service-proxy" containerID="cri-o://06edb12a3891734bf637099b432852c2810db7a6ceb1616ac17595337df3d3a6" gracePeriod=30
May 28 18:29:33.570084 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.569991    2563 generic.go:358] "Generic (PLEG): container finished" podID="0d0cce43-0000-4817-93c7-600083b86f90" containerID="06edb12a3891734bf637099b432852c2810db7a6ceb1616ac17595337df3d3a6" exitCode=2
May 28 18:29:33.570084 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.570049    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerDied","Data":"06edb12a3891734bf637099b432852c2810db7a6ceb1616ac17595337df3d3a6"}
May 28 18:29:33.570084 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:33.570084    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7fdb9fddd4-vftlp" event={"ID":"0d0cce43-0000-4817-93c7-600083b86f90","Type":"ContainerStarted","Data":"7289a986d41a0cc3a5c3b24c23e9e2fd7bec49dc571859324bba51d5a79c7f0d"}
May 28 18:29:40.760410 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:40.760356    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:29:40.762807 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:40.762783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2953c6b4-0ac6-4448-b422-f72618caf8b3-metrics-certs\") pod \"network-metrics-daemon-xmn9f\" (UID: \"2953c6b4-0ac6-4448-b422-f72618caf8b3\") " pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:29:40.991284 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:40.991252    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2t4h\""
May 28 18:29:40.996435 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:40.996420    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xmn9f"
May 28 18:29:41.117930 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:41.117901    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xmn9f"]
May 28 18:29:41.120944 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:29:41.120923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2953c6b4_0ac6_4448_b422_f72618caf8b3.slice/crio-fa18bbf994a737062c59d160da8a66a52d1f38e9ce55a550a53d33e0168a9b11 WatchSource:0}: Error finding container fa18bbf994a737062c59d160da8a66a52d1f38e9ce55a550a53d33e0168a9b11: Status 404 returned error can't find the container with id fa18bbf994a737062c59d160da8a66a52d1f38e9ce55a550a53d33e0168a9b11
May 28 18:29:41.591987 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:41.591948    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmn9f" event={"ID":"2953c6b4-0ac6-4448-b422-f72618caf8b3","Type":"ContainerStarted","Data":"fa18bbf994a737062c59d160da8a66a52d1f38e9ce55a550a53d33e0168a9b11"}
May 28 18:29:42.596942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:42.596914    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmn9f" event={"ID":"2953c6b4-0ac6-4448-b422-f72618caf8b3","Type":"ContainerStarted","Data":"6e10957434694475069093402d83805689c76bc5c2454b208734a55c98db3eaf"}
May 28 18:29:42.597268 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:42.596951    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xmn9f" event={"ID":"2953c6b4-0ac6-4448-b422-f72618caf8b3","Type":"ContainerStarted","Data":"b62f844447a5cc8493b2ac12d09216ed9ddfe21ebdf94ba4ccc448ccee00452f"}
May 28 18:29:42.628642 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:29:42.626303    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xmn9f" podStartSLOduration=252.31386872 podStartE2EDuration="4m13.626281736s" podCreationTimestamp="2026-05-28 18:25:29 +0000 UTC" firstStartedPulling="2026-05-28 18:29:41.122751147 +0000 UTC m=+252.741518112" lastFinishedPulling="2026-05-28 18:29:42.435164157 +0000 UTC m=+254.053931128" observedRunningTime="2026-05-28 18:29:42.624108474 +0000 UTC m=+254.242875457" watchObservedRunningTime="2026-05-28 18:29:42.626281736 +0000 UTC m=+254.245048720"
May 28 18:30:09.333154 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:30:09.333088    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8" podUID="ac45cf08-9a72-4348-9ce1-45664931e225"
May 28 18:30:09.333154 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:30:09.333089    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-w8dbq" podUID="991b67c7-ef9c-4fde-bf3f-601c61ecbbd3"
May 28 18:30:09.664357 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:09.664279    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:30:09.664357 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:09.664315    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:30:12.805444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.805407    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:30:12.807953 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.807928    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ac45cf08-9a72-4348-9ce1-45664931e225-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-7vbl8\" (UID: \"ac45cf08-9a72-4348-9ce1-45664931e225\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:30:12.906277 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.906232    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:30:12.908486 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.908468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/991b67c7-ef9c-4fde-bf3f-601c61ecbbd3-cert\") pod \"ingress-canary-w8dbq\" (UID: \"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3\") " pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:30:12.971378 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.971325    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2m48c\""
May 28 18:30:12.972070 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.972051    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n7dfk\""
May 28 18:30:12.976181 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.976165    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w8dbq"
May 28 18:30:12.976259 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:12.976178    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"
May 28 18:30:13.111031 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:13.111003    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8"]
May 28 18:30:13.114424 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:30:13.114395    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac45cf08_9a72_4348_9ce1_45664931e225.slice/crio-b55071a0cded0a964195e72282c7bbd311db28350e1d1e2f8e487e9b1cc28f27 WatchSource:0}: Error finding container b55071a0cded0a964195e72282c7bbd311db28350e1d1e2f8e487e9b1cc28f27: Status 404 returned error can't find the container with id b55071a0cded0a964195e72282c7bbd311db28350e1d1e2f8e487e9b1cc28f27
May 28 18:30:13.128734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:13.128708    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w8dbq"]
May 28 18:30:13.131958 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:30:13.131924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991b67c7_ef9c_4fde_bf3f_601c61ecbbd3.slice/crio-1a98db4a0d46b3d88a307f949d8fd2c1ae1c52550f2944e0f74aca6542296105 WatchSource:0}: Error finding container 1a98db4a0d46b3d88a307f949d8fd2c1ae1c52550f2944e0f74aca6542296105: Status 404 returned error can't find the container with id 1a98db4a0d46b3d88a307f949d8fd2c1ae1c52550f2944e0f74aca6542296105
May 28 18:30:13.676698 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:13.676656    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8" event={"ID":"ac45cf08-9a72-4348-9ce1-45664931e225","Type":"ContainerStarted","Data":"b55071a0cded0a964195e72282c7bbd311db28350e1d1e2f8e487e9b1cc28f27"}
May 28 18:30:13.677823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:13.677784    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8dbq" event={"ID":"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3","Type":"ContainerStarted","Data":"1a98db4a0d46b3d88a307f949d8fd2c1ae1c52550f2944e0f74aca6542296105"}
May 28 18:30:14.682629 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:14.682589    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8" event={"ID":"ac45cf08-9a72-4348-9ce1-45664931e225","Type":"ContainerStarted","Data":"d1d7c68fbbfa1ae994487bc58b16c62728100ac854599c8c07c1c6680b5caf6a"}
May 28 18:30:14.704077 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:14.704008    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-7vbl8" podStartSLOduration=282.5691428 podStartE2EDuration="4m43.703988548s" podCreationTimestamp="2026-05-28 18:25:31 +0000 UTC" firstStartedPulling="2026-05-28 18:30:13.116386363 +0000 UTC m=+284.735153325" lastFinishedPulling="2026-05-28 18:30:14.251232099 +0000 UTC m=+285.869999073" observedRunningTime="2026-05-28 18:30:14.701143586 +0000 UTC m=+286.319910568" watchObservedRunningTime="2026-05-28 18:30:14.703988548 +0000 UTC m=+286.322755534"
May 28 18:30:15.689823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:15.689785    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w8dbq" event={"ID":"991b67c7-ef9c-4fde-bf3f-601c61ecbbd3","Type":"ContainerStarted","Data":"3fc7b15783357e5169caf7feb9633293c79ed0818ad81d3f4510fc107d87c5eb"}
May 28 18:30:15.709871 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:15.709821    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w8dbq" podStartSLOduration=251.746437739 podStartE2EDuration="4m13.709807605s" podCreationTimestamp="2026-05-28 18:26:02 +0000 UTC" firstStartedPulling="2026-05-28 18:30:13.133608765 +0000 UTC m=+284.752375730" lastFinishedPulling="2026-05-28 18:30:15.09697862 +0000 UTC m=+286.715745596" observedRunningTime="2026-05-28 18:30:15.709075323 +0000 UTC m=+287.327842300" watchObservedRunningTime="2026-05-28 18:30:15.709807605 +0000 UTC m=+287.328574585"
May 28 18:30:28.803670 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:30:28.803640    2563 kubelet.go:1628] "Image garbage collection succeeded"
May 28 18:31:59.154200 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.154166    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"]
May 28 18:31:59.157270 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.157253    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.159594 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.159572    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:31:59.159594 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.159579    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\""
May 28 18:31:59.159748 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.159624    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:31:59.165030 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.165002    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"]
May 28 18:31:59.238185 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.238141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.238359 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.238237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.238359 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.238270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2sb\" (UniqueName: \"kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.339216 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.339180    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2sb\" (UniqueName: \"kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.339342 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.339224    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.339342 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.339271    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.339598 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.339559    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.339651 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.339631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.347473 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.347448    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2sb\" (UniqueName: \"kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.466444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.466356    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:31:59.587857 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.587824    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"]
May 28 18:31:59.590939 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:31:59.590912    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b6afb1_fc0a_4445_ba8e_357e4680d731.slice/crio-11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40 WatchSource:0}: Error finding container 11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40: Status 404 returned error can't find the container with id 11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40
May 28 18:31:59.592608 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.592592    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:31:59.946269 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:31:59.946234    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerStarted","Data":"11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40"}
May 28 18:32:04.962158 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:04.962122    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerStarted","Data":"8bc3808248bc85db483ccc8311b082855de11f91e0286fb3d496932c0bebf428"}
May 28 18:32:05.965848 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:05.965810    2563 generic.go:358] "Generic (PLEG): container finished" podID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerID="8bc3808248bc85db483ccc8311b082855de11f91e0286fb3d496932c0bebf428" exitCode=0
May 28 18:32:05.966234 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:05.965871    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerDied","Data":"8bc3808248bc85db483ccc8311b082855de11f91e0286fb3d496932c0bebf428"}
May 28 18:32:06.970252 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:06.970158    2563 generic.go:358] "Generic (PLEG): container finished" podID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerID="3347332b0152c913468a904f152735df9f654bc61734342aa4c85af0825c2c76" exitCode=0
May 28 18:32:06.970252 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:06.970215    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerDied","Data":"3347332b0152c913468a904f152735df9f654bc61734342aa4c85af0825c2c76"}
May 28 18:32:14.993375 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:14.993330    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerStarted","Data":"88e371b0ac4379fbb5b5e442308fef3c5bfa4b76265bd823dbd0b5f9f2a29253"}
May 28 18:32:15.012969 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:15.012903    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" podStartSLOduration=0.779241269 podStartE2EDuration="16.012884852s" podCreationTimestamp="2026-05-28 18:31:59 +0000 UTC" firstStartedPulling="2026-05-28 18:31:59.592715068 +0000 UTC m=+391.211482029" lastFinishedPulling="2026-05-28 18:32:14.826358646 +0000 UTC m=+406.445125612" observedRunningTime="2026-05-28 18:32:15.011228956 +0000 UTC m=+406.629995943" watchObservedRunningTime="2026-05-28 18:32:15.012884852 +0000 UTC m=+406.631651839"
May 28 18:32:15.997178 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:15.997142    2563 generic.go:358] "Generic (PLEG): container finished" podID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerID="88e371b0ac4379fbb5b5e442308fef3c5bfa4b76265bd823dbd0b5f9f2a29253" exitCode=0
May 28 18:32:15.997583 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:15.997221    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerDied","Data":"88e371b0ac4379fbb5b5e442308fef3c5bfa4b76265bd823dbd0b5f9f2a29253"}
May 28 18:32:17.115218 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.115189    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:32:17.171783 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.171745    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util\") pod \"37b6afb1-fc0a-4445-ba8e-357e4680d731\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") "
May 28 18:32:17.171963 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.171820    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn2sb\" (UniqueName: \"kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb\") pod \"37b6afb1-fc0a-4445-ba8e-357e4680d731\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") "
May 28 18:32:17.171963 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.171856    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle\") pod \"37b6afb1-fc0a-4445-ba8e-357e4680d731\" (UID: \"37b6afb1-fc0a-4445-ba8e-357e4680d731\") "
May 28 18:32:17.172463 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.172431    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle" (OuterVolumeSpecName: "bundle") pod "37b6afb1-fc0a-4445-ba8e-357e4680d731" (UID: "37b6afb1-fc0a-4445-ba8e-357e4680d731"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:32:17.174036 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.174000    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb" (OuterVolumeSpecName: "kube-api-access-cn2sb") pod "37b6afb1-fc0a-4445-ba8e-357e4680d731" (UID: "37b6afb1-fc0a-4445-ba8e-357e4680d731"). InnerVolumeSpecName "kube-api-access-cn2sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:32:17.176452 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.176431    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util" (OuterVolumeSpecName: "util") pod "37b6afb1-fc0a-4445-ba8e-357e4680d731" (UID: "37b6afb1-fc0a-4445-ba8e-357e4680d731"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:32:17.272870 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.272789    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn2sb\" (UniqueName: \"kubernetes.io/projected/37b6afb1-fc0a-4445-ba8e-357e4680d731-kube-api-access-cn2sb\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:32:17.272870 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.272820    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:32:17.272870 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:17.272830    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37b6afb1-fc0a-4445-ba8e-357e4680d731-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:32:18.004132 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:18.004094    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz" event={"ID":"37b6afb1-fc0a-4445-ba8e-357e4680d731","Type":"ContainerDied","Data":"11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40"}
May 28 18:32:18.004132 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:18.004139    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11189edd77cf54d77565f84eb7b77dfa941d502fea9360f8e5bee79698088b40"
May 28 18:32:18.004366 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:18.004107    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d98dzz"
May 28 18:32:31.855557 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855523    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5hkkw"]
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855785    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="pull"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855798    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="pull"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855806    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="extract"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="extract"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855819    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="util"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855825    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="util"
May 28 18:32:31.856042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.855865    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="37b6afb1-fc0a-4445-ba8e-357e4680d731" containerName="extract"
May 28 18:32:31.858577 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.858549    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:31.862410 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.862384    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 28 18:32:31.863272 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.863256    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-54h59\""
May 28 18:32:31.863428 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.863408    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 28 18:32:31.872455 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.872428    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5hkkw"]
May 28 18:32:31.975689 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.975651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:31.975864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:31.975699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrzt\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-kube-api-access-psrzt\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.076174 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.076126    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.076370 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.076186    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psrzt\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-kube-api-access-psrzt\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.085614 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.085580    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.085721 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.085589    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrzt\" (UniqueName: \"kubernetes.io/projected/6fb862a7-ae51-467b-8235-2e42dc1ce89c-kube-api-access-psrzt\") pod \"cert-manager-cainjector-68b757865b-5hkkw\" (UID: \"6fb862a7-ae51-467b-8235-2e42dc1ce89c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.166921 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.166809    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw"
May 28 18:32:32.287883 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:32.287848    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5hkkw"]
May 28 18:32:32.290849 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:32:32.290821    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fb862a7_ae51_467b_8235_2e42dc1ce89c.slice/crio-96bb84e8386945aed0da312d953997713d28f3c5704873e01c9151213b861ba3 WatchSource:0}: Error finding container 96bb84e8386945aed0da312d953997713d28f3c5704873e01c9151213b861ba3: Status 404 returned error can't find the container with id 96bb84e8386945aed0da312d953997713d28f3c5704873e01c9151213b861ba3
May 28 18:32:33.046172 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:33.046130    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw" event={"ID":"6fb862a7-ae51-467b-8235-2e42dc1ce89c","Type":"ContainerStarted","Data":"96bb84e8386945aed0da312d953997713d28f3c5704873e01c9151213b861ba3"}
May 28 18:32:40.068759 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:40.068721    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw" event={"ID":"6fb862a7-ae51-467b-8235-2e42dc1ce89c","Type":"ContainerStarted","Data":"7b2b3fa5227793eef93204bcf7db3148bfaa1b5a995bd9bd90fbfa5b10ed4b99"}
May 28 18:32:40.084674 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:40.084622    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-5hkkw" podStartSLOduration=2.355840532 podStartE2EDuration="9.084608237s" podCreationTimestamp="2026-05-28 18:32:31 +0000 UTC" firstStartedPulling="2026-05-28 18:32:32.292676491 +0000 UTC m=+423.911443452" lastFinishedPulling="2026-05-28 18:32:39.021444196 +0000 UTC m=+430.640211157" observedRunningTime="2026-05-28 18:32:40.08300402 +0000 UTC m=+431.701771004" watchObservedRunningTime="2026-05-28 18:32:40.084608237 +0000 UTC m=+431.703375220"
May 28 18:32:56.722310 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.722225    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"]
May 28 18:32:56.724407 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.724391    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.726679 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.726655    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:32:56.726807 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.726657    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:32:56.727578 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.727545    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\""
May 28 18:32:56.732285 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.732260    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"]
May 28 18:32:56.844456 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.844417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwgj\" (UniqueName: \"kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.844456 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.844459    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.844690 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.844548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.945228 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.945192    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwgj\" (UniqueName: \"kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.945228 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.945231    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.945484 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.945291    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.945729 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.945709    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.945786 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.945724    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:56.953750 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:56.953733    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwgj\" (UniqueName: \"kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj\") pod \"3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") " pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:57.033826 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:57.033743    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:32:57.154973 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:57.154943    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"]
May 28 18:32:57.157929 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:32:57.157899    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda60e1244_1afd_4c47_826d_ed8177c6ce53.slice/crio-a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf WatchSource:0}: Error finding container a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf: Status 404 returned error can't find the container with id a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf
May 28 18:32:58.122292 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:58.122253    2563 generic.go:358] "Generic (PLEG): container finished" podID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerID="482a04c213ce2d1f85e8bc78a0eb0ffef8c3a1827a63b236fbe4e818c5520588" exitCode=0
May 28 18:32:58.122688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:58.122343    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn" event={"ID":"a60e1244-1afd-4c47-826d-ed8177c6ce53","Type":"ContainerDied","Data":"482a04c213ce2d1f85e8bc78a0eb0ffef8c3a1827a63b236fbe4e818c5520588"}
May 28 18:32:58.122688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:58.122381    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn" event={"ID":"a60e1244-1afd-4c47-826d-ed8177c6ce53","Type":"ContainerStarted","Data":"a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf"}
May 28 18:32:59.126088 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:59.126047    2563 generic.go:358] "Generic (PLEG): container finished" podID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerID="c45be87ce8c5bfb45e86cefcc083e6eb967f9eb769f43c06ee1e96eece51150d" exitCode=0
May 28 18:32:59.126462 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:32:59.126088    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn" event={"ID":"a60e1244-1afd-4c47-826d-ed8177c6ce53","Type":"ContainerDied","Data":"c45be87ce8c5bfb45e86cefcc083e6eb967f9eb769f43c06ee1e96eece51150d"}
May 28 18:33:00.130238 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:00.130198    2563 generic.go:358] "Generic (PLEG): container finished" podID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerID="53bbdd6df2fb6b22fbb35c4252ee49215b2907c2b186f5de9447c409127b144a" exitCode=0
May 28 18:33:00.130238 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:00.130241    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn" event={"ID":"a60e1244-1afd-4c47-826d-ed8177c6ce53","Type":"ContainerDied","Data":"53bbdd6df2fb6b22fbb35c4252ee49215b2907c2b186f5de9447c409127b144a"}
May 28 18:33:01.253843 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.253819    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:33:01.376163 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.376113    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle\") pod \"a60e1244-1afd-4c47-826d-ed8177c6ce53\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") "
May 28 18:33:01.376319 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.376203    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rwgj\" (UniqueName: \"kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj\") pod \"a60e1244-1afd-4c47-826d-ed8177c6ce53\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") "
May 28 18:33:01.376319 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.376225    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util\") pod \"a60e1244-1afd-4c47-826d-ed8177c6ce53\" (UID: \"a60e1244-1afd-4c47-826d-ed8177c6ce53\") "
May 28 18:33:01.376967 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.376936    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle" (OuterVolumeSpecName: "bundle") pod "a60e1244-1afd-4c47-826d-ed8177c6ce53" (UID: "a60e1244-1afd-4c47-826d-ed8177c6ce53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:01.378301 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.378279    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj" (OuterVolumeSpecName: "kube-api-access-2rwgj") pod "a60e1244-1afd-4c47-826d-ed8177c6ce53" (UID: "a60e1244-1afd-4c47-826d-ed8177c6ce53"). InnerVolumeSpecName "kube-api-access-2rwgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:33:01.384389 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.384356    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util" (OuterVolumeSpecName: "util") pod "a60e1244-1afd-4c47-826d-ed8177c6ce53" (UID: "a60e1244-1afd-4c47-826d-ed8177c6ce53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:01.476829 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.476792    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rwgj\" (UniqueName: \"kubernetes.io/projected/a60e1244-1afd-4c47-826d-ed8177c6ce53-kube-api-access-2rwgj\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:01.476829 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.476826    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:01.476829 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:01.476837    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a60e1244-1afd-4c47-826d-ed8177c6ce53-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:02.136845 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:02.136803    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn" event={"ID":"a60e1244-1afd-4c47-826d-ed8177c6ce53","Type":"ContainerDied","Data":"a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf"}
May 28 18:33:02.136845 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:02.136844    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/3081035efbc3f76b8ae1b663abbd2a6bc5b4896fe94818011b247755c58bwjn"
May 28 18:33:02.137157 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:02.136847    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a070c4eb1f77f57dd7a532da01b9f604f351ebbed1de4f2846942ccbac54fbdf"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568431    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"]
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568939    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="pull"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568956    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="pull"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568971    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="extract"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568986    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="extract"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.568999    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="util"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.569008    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="util"
May 28 18:33:07.570734 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.569128    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="a60e1244-1afd-4c47-826d-ed8177c6ce53" containerName="extract"
May 28 18:33:07.572429 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.572409    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.574760 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.574737    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\""
May 28 18:33:07.574885 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.574771    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:33:07.577679 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.577660    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:33:07.581921 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.581900    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"]
May 28 18:33:07.721516 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.721467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r62j7\" (UniqueName: \"kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.721516 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.721520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.721744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.721603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.822482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.822383    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r62j7\" (UniqueName: \"kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.822482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.822434    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.822482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.822461    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.822840 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.822823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.822917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.822862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.830373 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.830344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r62j7\" (UniqueName: \"kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7\") pod \"f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") " pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:07.881370 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:07.881332    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:08.016179 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:08.016088    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"]
May 28 18:33:08.018639 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:08.018599    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e29320_6f70_42ca_a0a1_dba2715ff4fa.slice/crio-96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f WatchSource:0}: Error finding container 96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f: Status 404 returned error can't find the container with id 96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f
May 28 18:33:08.154357 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:08.154328    2563 generic.go:358] "Generic (PLEG): container finished" podID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerID="33ffba4388ff466ce030c80b400a364f3e4c5806290050b45d2e80b2e9b1cbf2" exitCode=0
May 28 18:33:08.154499 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:08.154406    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt" event={"ID":"69e29320-6f70-42ca-a0a1-dba2715ff4fa","Type":"ContainerDied","Data":"33ffba4388ff466ce030c80b400a364f3e4c5806290050b45d2e80b2e9b1cbf2"}
May 28 18:33:08.154499 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:08.154432    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt" event={"ID":"69e29320-6f70-42ca-a0a1-dba2715ff4fa","Type":"ContainerStarted","Data":"96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f"}
May 28 18:33:09.159172 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.159083    2563 generic.go:358] "Generic (PLEG): container finished" podID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerID="ffa39918fd8f85e310ea649bdf2f9aef4ea81e0243f740bbca9fbde414ddd903" exitCode=0
May 28 18:33:09.159521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.159174    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt" event={"ID":"69e29320-6f70-42ca-a0a1-dba2715ff4fa","Type":"ContainerDied","Data":"ffa39918fd8f85e310ea649bdf2f9aef4ea81e0243f740bbca9fbde414ddd903"}
May 28 18:33:09.165059 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.165032    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"]
May 28 18:33:09.167241 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.167224    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.169679 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.169660    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 18:33:09.169679 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.169670    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 18:33:09.169844 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.169681    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 18:33:09.169844 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.169763    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 18:33:09.169844 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.169693    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l9hnf\""
May 28 18:33:09.189942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.189916    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"]
May 28 18:33:09.232714 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.232685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79bn4\" (UniqueName: \"kubernetes.io/projected/9ab6f240-75a3-40a3-8282-38d2208c3c33-kube-api-access-79bn4\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.232812 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.232776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.232860 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.232820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.333861 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.333836    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79bn4\" (UniqueName: \"kubernetes.io/projected/9ab6f240-75a3-40a3-8282-38d2208c3c33-kube-api-access-79bn4\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.333974 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.333889    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.333974 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.333918    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.336246 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.336221    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-webhook-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.336329 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.336218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ab6f240-75a3-40a3-8282-38d2208c3c33-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.341932 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.341911    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79bn4\" (UniqueName: \"kubernetes.io/projected/9ab6f240-75a3-40a3-8282-38d2208c3c33-kube-api-access-79bn4\") pod \"opendatahub-operator-controller-manager-67686c6958-7vh6d\" (UID: \"9ab6f240-75a3-40a3-8282-38d2208c3c33\") " pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.501012 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.500923    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:09.628911 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:09.628753    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"]
May 28 18:33:09.631581 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:09.631533    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab6f240_75a3_40a3_8282_38d2208c3c33.slice/crio-06aa623f196337c067bb08dea176476a71740c348b2fbf966b8d6e9648599376 WatchSource:0}: Error finding container 06aa623f196337c067bb08dea176476a71740c348b2fbf966b8d6e9648599376: Status 404 returned error can't find the container with id 06aa623f196337c067bb08dea176476a71740c348b2fbf966b8d6e9648599376
May 28 18:33:10.168348 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:10.168298    2563 generic.go:358] "Generic (PLEG): container finished" podID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerID="18e0cf1dd825f1778d01262053a86acfafeb04f4f35eccb4bae95fbe9f8cfa02" exitCode=0
May 28 18:33:10.168824 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:10.168385    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt" event={"ID":"69e29320-6f70-42ca-a0a1-dba2715ff4fa","Type":"ContainerDied","Data":"18e0cf1dd825f1778d01262053a86acfafeb04f4f35eccb4bae95fbe9f8cfa02"}
May 28 18:33:10.170267 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:10.170222    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d" event={"ID":"9ab6f240-75a3-40a3-8282-38d2208c3c33","Type":"ContainerStarted","Data":"06aa623f196337c067bb08dea176476a71740c348b2fbf966b8d6e9648599376"}
May 28 18:33:11.376720 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.376694    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:11.453435 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.453350    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle\") pod \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") "
May 28 18:33:11.453435 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.453407    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r62j7\" (UniqueName: \"kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7\") pod \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") "
May 28 18:33:11.453435 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.453436    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util\") pod \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\" (UID: \"69e29320-6f70-42ca-a0a1-dba2715ff4fa\") "
May 28 18:33:11.454263 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.454234    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle" (OuterVolumeSpecName: "bundle") pod "69e29320-6f70-42ca-a0a1-dba2715ff4fa" (UID: "69e29320-6f70-42ca-a0a1-dba2715ff4fa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:11.455733 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.455711    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7" (OuterVolumeSpecName: "kube-api-access-r62j7") pod "69e29320-6f70-42ca-a0a1-dba2715ff4fa" (UID: "69e29320-6f70-42ca-a0a1-dba2715ff4fa"). InnerVolumeSpecName "kube-api-access-r62j7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:33:11.460014 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.459992    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util" (OuterVolumeSpecName: "util") pod "69e29320-6f70-42ca-a0a1-dba2715ff4fa" (UID: "69e29320-6f70-42ca-a0a1-dba2715ff4fa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:11.554726 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.554682    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r62j7\" (UniqueName: \"kubernetes.io/projected/69e29320-6f70-42ca-a0a1-dba2715ff4fa-kube-api-access-r62j7\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:11.554726 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.554723    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:11.554918 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:11.554737    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69e29320-6f70-42ca-a0a1-dba2715ff4fa-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:12.179528 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.179495    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt" event={"ID":"69e29320-6f70-42ca-a0a1-dba2715ff4fa","Type":"ContainerDied","Data":"96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f"}
May 28 18:33:12.179528 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.179527    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f77c1a82ade775f7608969957d57ee0b8db93eeada9825bd6f7f7156c9lbzlt"
May 28 18:33:12.179759 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.179530    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96c8d07d00323a7242b91b54d37d17af60ab46210ac38b5959d7dc46b0f9797f"
May 28 18:33:12.181062 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.181029    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d" event={"ID":"9ab6f240-75a3-40a3-8282-38d2208c3c33","Type":"ContainerStarted","Data":"5010f2bd82f93e772947bdbedefe2393286016d106d5845e34e476be5aaef6ad"}
May 28 18:33:12.181194 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.181084    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:12.204966 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:12.204920    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d" podStartSLOduration=0.871447629 podStartE2EDuration="3.204906418s" podCreationTimestamp="2026-05-28 18:33:09 +0000 UTC" firstStartedPulling="2026-05-28 18:33:09.633339115 +0000 UTC m=+461.252106079" lastFinishedPulling="2026-05-28 18:33:11.966797894 +0000 UTC m=+463.585564868" observedRunningTime="2026-05-28 18:33:12.202797574 +0000 UTC m=+463.821564555" watchObservedRunningTime="2026-05-28 18:33:12.204906418 +0000 UTC m=+463.823673400"
May 28 18:33:23.186892 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:23.186862    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67686c6958-7vh6d"
May 28 18:33:29.700996 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.700950    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nbmc2"]
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701292    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="util"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701310    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="util"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701320    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="pull"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701328    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="pull"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701343    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="extract"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701352    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="extract"
May 28 18:33:29.701474 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.701408    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="69e29320-6f70-42ca-a0a1-dba2715ff4fa" containerName="extract"
May 28 18:33:29.704628 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.704607    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:29.707255 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.707234    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 28 18:33:29.707349 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.707238    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-cl268\""
May 28 18:33:29.712174 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.712149    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nbmc2"]
May 28 18:33:29.892861 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.892825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dptmh\" (UniqueName: \"kubernetes.io/projected/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-kube-api-access-dptmh\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:29.893019 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.892888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:29.994264 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.994174    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:29.994264 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:29.994243    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dptmh\" (UniqueName: \"kubernetes.io/projected/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-kube-api-access-dptmh\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:29.994507 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:29.994334    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 28 18:33:29.994507 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:29.994416    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert podName:1360dfcd-d4f8-4d45-840d-6671f8ba4de7 nodeName:}" failed. No retries permitted until 2026-05-28 18:33:30.494398938 +0000 UTC m=+482.113165900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert") pod "odh-model-controller-858dbf95b8-nbmc2" (UID: "1360dfcd-d4f8-4d45-840d-6671f8ba4de7") : secret "odh-model-controller-webhook-cert" not found
May 28 18:33:30.003555 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:30.003528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dptmh\" (UniqueName: \"kubernetes.io/projected/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-kube-api-access-dptmh\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:30.499990 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:30.499945    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:30.502351 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:30.502322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1360dfcd-d4f8-4d45-840d-6671f8ba4de7-cert\") pod \"odh-model-controller-858dbf95b8-nbmc2\" (UID: \"1360dfcd-d4f8-4d45-840d-6671f8ba4de7\") " pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:30.615823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:30.615782    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:30.743268 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:30.743233    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-nbmc2"]
May 28 18:33:30.746640 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:30.746610    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1360dfcd_d4f8_4d45_840d_6671f8ba4de7.slice/crio-55dd896a05c3bae7a69553fef8996d3c11f4681d93e390e361ab898c3fdf2101 WatchSource:0}: Error finding container 55dd896a05c3bae7a69553fef8996d3c11f4681d93e390e361ab898c3fdf2101: Status 404 returned error can't find the container with id 55dd896a05c3bae7a69553fef8996d3c11f4681d93e390e361ab898c3fdf2101
May 28 18:33:31.232186 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:31.232149    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" event={"ID":"1360dfcd-d4f8-4d45-840d-6671f8ba4de7","Type":"ContainerStarted","Data":"55dd896a05c3bae7a69553fef8996d3c11f4681d93e390e361ab898c3fdf2101"}
May 28 18:33:33.240266 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:33.240224    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" event={"ID":"1360dfcd-d4f8-4d45-840d-6671f8ba4de7","Type":"ContainerStarted","Data":"58e3df7242ee8b00c6ecc2de82ac2f2ddb1819a1dfe0276c31ee38bb90a61933"}
May 28 18:33:33.240825 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:33.240799    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:33.257490 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:33.257429    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" podStartSLOduration=1.9309768649999999 podStartE2EDuration="4.257410236s" podCreationTimestamp="2026-05-28 18:33:29 +0000 UTC" firstStartedPulling="2026-05-28 18:33:30.748027413 +0000 UTC m=+482.366794373" lastFinishedPulling="2026-05-28 18:33:33.074460782 +0000 UTC m=+484.693227744" observedRunningTime="2026-05-28 18:33:33.256172336 +0000 UTC m=+484.874939320" watchObservedRunningTime="2026-05-28 18:33:33.257410236 +0000 UTC m=+484.876177220"
May 28 18:33:34.244950 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:34.244920    2563 generic.go:358] "Generic (PLEG): container finished" podID="1360dfcd-d4f8-4d45-840d-6671f8ba4de7" containerID="58e3df7242ee8b00c6ecc2de82ac2f2ddb1819a1dfe0276c31ee38bb90a61933" exitCode=1
May 28 18:33:34.245521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:34.245000    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" event={"ID":"1360dfcd-d4f8-4d45-840d-6671f8ba4de7","Type":"ContainerDied","Data":"58e3df7242ee8b00c6ecc2de82ac2f2ddb1819a1dfe0276c31ee38bb90a61933"}
May 28 18:33:34.245521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:34.245287    2563 scope.go:117] "RemoveContainer" containerID="58e3df7242ee8b00c6ecc2de82ac2f2ddb1819a1dfe0276c31ee38bb90a61933"
May 28 18:33:35.249026 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.248992    2563 generic.go:358] "Generic (PLEG): container finished" podID="1360dfcd-d4f8-4d45-840d-6671f8ba4de7" containerID="361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d" exitCode=1
May 28 18:33:35.249492 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.249081    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" event={"ID":"1360dfcd-d4f8-4d45-840d-6671f8ba4de7","Type":"ContainerDied","Data":"361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d"}
May 28 18:33:35.249492 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.249149    2563 scope.go:117] "RemoveContainer" containerID="58e3df7242ee8b00c6ecc2de82ac2f2ddb1819a1dfe0276c31ee38bb90a61933"
May 28 18:33:35.249492 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.249298    2563 scope.go:117] "RemoveContainer" containerID="361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d"
May 28 18:33:35.249744 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:35.249498    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nbmc2_opendatahub(1360dfcd-d4f8-4d45-840d-6671f8ba4de7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" podUID="1360dfcd-d4f8-4d45-840d-6671f8ba4de7"
May 28 18:33:35.301795 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.301759    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-fdvs5"]
May 28 18:33:35.305908 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.305888    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:35.308758 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.308739    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 28 18:33:35.308837 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.308738    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rxrvr\""
May 28 18:33:35.318460 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.318430    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-fdvs5"]
May 28 18:33:35.436305 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.436270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8hrt\" (UniqueName: \"kubernetes.io/projected/97caf7bc-1c64-4748-9f14-29d127c7bec5-kube-api-access-w8hrt\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:35.436305 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.436317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:35.537482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.537398    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8hrt\" (UniqueName: \"kubernetes.io/projected/97caf7bc-1c64-4748-9f14-29d127c7bec5-kube-api-access-w8hrt\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:35.537482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.537442    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:35.537699 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:35.537539    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 18:33:35.537699 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:35.537621    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert podName:97caf7bc-1c64-4748-9f14-29d127c7bec5 nodeName:}" failed. No retries permitted until 2026-05-28 18:33:36.0376018 +0000 UTC m=+487.656368761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert") pod "kserve-controller-manager-856948b99f-fdvs5" (UID: "97caf7bc-1c64-4748-9f14-29d127c7bec5") : secret "kserve-webhook-server-cert" not found
May 28 18:33:35.546813 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:35.546787    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8hrt\" (UniqueName: \"kubernetes.io/projected/97caf7bc-1c64-4748-9f14-29d127c7bec5-kube-api-access-w8hrt\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:36.040005 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.039969    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:36.040194 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:36.040108    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 28 18:33:36.040194 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:36.040166    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert podName:97caf7bc-1c64-4748-9f14-29d127c7bec5 nodeName:}" failed. No retries permitted until 2026-05-28 18:33:37.040147454 +0000 UTC m=+488.658914415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert") pod "kserve-controller-manager-856948b99f-fdvs5" (UID: "97caf7bc-1c64-4748-9f14-29d127c7bec5") : secret "kserve-webhook-server-cert" not found
May 28 18:33:36.253286 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.253257    2563 scope.go:117] "RemoveContainer" containerID="361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d"
May 28 18:33:36.253659 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:36.253415    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nbmc2_opendatahub(1360dfcd-d4f8-4d45-840d-6671f8ba4de7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" podUID="1360dfcd-d4f8-4d45-840d-6671f8ba4de7"
May 28 18:33:36.961941 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.961909    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"]
May 28 18:33:36.965220 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.965201    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:36.967674 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.967650    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:33:36.968138 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.968110    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:33:36.968636 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.968620    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\""
May 28 18:33:36.976607 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:36.976582    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"]
May 28 18:33:37.047383 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.047346    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:37.047383 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.047388    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.047610 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.047417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsns2\" (UniqueName: \"kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.047610 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.047516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.049957 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.049923    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97caf7bc-1c64-4748-9f14-29d127c7bec5-cert\") pod \"kserve-controller-manager-856948b99f-fdvs5\" (UID: \"97caf7bc-1c64-4748-9f14-29d127c7bec5\") " pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:37.115879 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.115841    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:37.148028 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.147992    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.148205 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.148041    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsns2\" (UniqueName: \"kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.148205 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.148080    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.148469 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.148447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.148540 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.148445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.158396 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.158364    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsns2\" (UniqueName: \"kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.244414 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.244338    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-fdvs5"]
May 28 18:33:37.250233 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:37.250194    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97caf7bc_1c64_4748_9f14_29d127c7bec5.slice/crio-3dcdf43db91afb48a327180f14e2c45818c22c3fdbe1b71d0105738540016724 WatchSource:0}: Error finding container 3dcdf43db91afb48a327180f14e2c45818c22c3fdbe1b71d0105738540016724: Status 404 returned error can't find the container with id 3dcdf43db91afb48a327180f14e2c45818c22c3fdbe1b71d0105738540016724
May 28 18:33:37.257078 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.257048    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5" event={"ID":"97caf7bc-1c64-4748-9f14-29d127c7bec5","Type":"ContainerStarted","Data":"3dcdf43db91afb48a327180f14e2c45818c22c3fdbe1b71d0105738540016724"}
May 28 18:33:37.274461 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.274427    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:37.361664 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.361633    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"]
May 28 18:33:37.366047 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.366023    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.368957 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.368519    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 18:33:37.369084 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.368987    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 18:33:37.369433 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.369283    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-578ch\""
May 28 18:33:37.369433 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.369303    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 18:33:37.369640 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.369524    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 18:33:37.376469 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.376440    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"]
May 28 18:33:37.412902 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.411321    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"]
May 28 18:33:37.415741 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:37.415705    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c83141_0e58_46e0_b507_db5b605d3af3.slice/crio-74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611 WatchSource:0}: Error finding container 74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611: Status 404 returned error can't find the container with id 74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611
May 28 18:33:37.450804 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.450768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tmp\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.450917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.450833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.450917 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.450881    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prm9f\" (UniqueName: \"kubernetes.io/projected/abbd8498-b8f1-423c-be58-cdffc4a96a9d-kube-api-access-prm9f\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.551476 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.551436    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.551674 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.551487    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prm9f\" (UniqueName: \"kubernetes.io/projected/abbd8498-b8f1-423c-be58-cdffc4a96a9d-kube-api-access-prm9f\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.551674 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.551527    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tmp\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.553653 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.553635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tmp\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.553875 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.553856    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/abbd8498-b8f1-423c-be58-cdffc4a96a9d-tls-certs\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.562558 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.562528    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prm9f\" (UniqueName: \"kubernetes.io/projected/abbd8498-b8f1-423c-be58-cdffc4a96a9d-kube-api-access-prm9f\") pod \"kube-auth-proxy-6d979fcbd5-f47tw\" (UID: \"abbd8498-b8f1-423c-be58-cdffc4a96a9d\") " pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.678244 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.678204    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"
May 28 18:33:37.800109 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:37.799969    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw"]
May 28 18:33:37.802377 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:37.802353    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabbd8498_b8f1_423c_be58_cdffc4a96a9d.slice/crio-787c683bcdca4642b9628d8f0df771f4ea5a7b34c92279accd0b917771e01521 WatchSource:0}: Error finding container 787c683bcdca4642b9628d8f0df771f4ea5a7b34c92279accd0b917771e01521: Status 404 returned error can't find the container with id 787c683bcdca4642b9628d8f0df771f4ea5a7b34c92279accd0b917771e01521
May 28 18:33:38.261761 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:38.261712    2563 generic.go:358] "Generic (PLEG): container finished" podID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerID="20dcec76b3e3de3cc37829e2f868069064c2179b6b76bb70c0b9540196f7e174" exitCode=0
May 28 18:33:38.262225 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:38.261805    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9" event={"ID":"f8c83141-0e58-46e0-b507-db5b605d3af3","Type":"ContainerDied","Data":"20dcec76b3e3de3cc37829e2f868069064c2179b6b76bb70c0b9540196f7e174"}
May 28 18:33:38.262225 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:38.261847    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9" event={"ID":"f8c83141-0e58-46e0-b507-db5b605d3af3","Type":"ContainerStarted","Data":"74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611"}
May 28 18:33:38.263098 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:38.263072    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw" event={"ID":"abbd8498-b8f1-423c-be58-cdffc4a96a9d","Type":"ContainerStarted","Data":"787c683bcdca4642b9628d8f0df771f4ea5a7b34c92279accd0b917771e01521"}
May 28 18:33:39.269213 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:39.269162    2563 generic.go:358] "Generic (PLEG): container finished" podID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerID="d563892c983d2f89c28a3aca172eac976c83077b477264bd4c5dd78007b606ff" exitCode=0
May 28 18:33:39.269683 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:39.269219    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9" event={"ID":"f8c83141-0e58-46e0-b507-db5b605d3af3","Type":"ContainerDied","Data":"d563892c983d2f89c28a3aca172eac976c83077b477264bd4c5dd78007b606ff"}
May 28 18:33:41.280642 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.280606    2563 generic.go:358] "Generic (PLEG): container finished" podID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerID="307165db642b24c219ddbd4aeca13d5bee71b490206015cd18bc37471c0d78ec" exitCode=0
May 28 18:33:41.281083 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.280689    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9" event={"ID":"f8c83141-0e58-46e0-b507-db5b605d3af3","Type":"ContainerDied","Data":"307165db642b24c219ddbd4aeca13d5bee71b490206015cd18bc37471c0d78ec"}
May 28 18:33:41.281979 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.281952    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw" event={"ID":"abbd8498-b8f1-423c-be58-cdffc4a96a9d","Type":"ContainerStarted","Data":"f89b1bdd322be87eaff35903a68e1d3530317a2fdf0c79c86006870b9118ce58"}
May 28 18:33:41.283178 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.283160    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5" event={"ID":"97caf7bc-1c64-4748-9f14-29d127c7bec5","Type":"ContainerStarted","Data":"6f8e026cf30e61ac9a0f7eff949d1654eb17b5d477521931e0e7e1496cf62d26"}
May 28 18:33:41.283287 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.283274    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:33:41.324578 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.324513    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5" podStartSLOduration=2.667439097 podStartE2EDuration="6.324499918s" podCreationTimestamp="2026-05-28 18:33:35 +0000 UTC" firstStartedPulling="2026-05-28 18:33:37.252036681 +0000 UTC m=+488.870803655" lastFinishedPulling="2026-05-28 18:33:40.909097513 +0000 UTC m=+492.527864476" observedRunningTime="2026-05-28 18:33:41.319965892 +0000 UTC m=+492.938732874" watchObservedRunningTime="2026-05-28 18:33:41.324499918 +0000 UTC m=+492.943266902"
May 28 18:33:41.359750 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:41.359685    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d979fcbd5-f47tw" podStartSLOduration=1.245285019 podStartE2EDuration="4.359667164s" podCreationTimestamp="2026-05-28 18:33:37 +0000 UTC" firstStartedPulling="2026-05-28 18:33:37.804036525 +0000 UTC m=+489.422803485" lastFinishedPulling="2026-05-28 18:33:40.91841867 +0000 UTC m=+492.537185630" observedRunningTime="2026-05-28 18:33:41.35791054 +0000 UTC m=+492.976677524" watchObservedRunningTime="2026-05-28 18:33:41.359667164 +0000 UTC m=+492.978434147"
May 28 18:33:42.405379 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.405353    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:42.484076 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.484025    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle\") pod \"f8c83141-0e58-46e0-b507-db5b605d3af3\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") "
May 28 18:33:42.484236 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.484090    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsns2\" (UniqueName: \"kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2\") pod \"f8c83141-0e58-46e0-b507-db5b605d3af3\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") "
May 28 18:33:42.484236 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.484123    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util\") pod \"f8c83141-0e58-46e0-b507-db5b605d3af3\" (UID: \"f8c83141-0e58-46e0-b507-db5b605d3af3\") "
May 28 18:33:42.485024 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.484987    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle" (OuterVolumeSpecName: "bundle") pod "f8c83141-0e58-46e0-b507-db5b605d3af3" (UID: "f8c83141-0e58-46e0-b507-db5b605d3af3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:42.486172 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.486144    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2" (OuterVolumeSpecName: "kube-api-access-dsns2") pod "f8c83141-0e58-46e0-b507-db5b605d3af3" (UID: "f8c83141-0e58-46e0-b507-db5b605d3af3"). InnerVolumeSpecName "kube-api-access-dsns2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:33:42.488893 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.488874    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util" (OuterVolumeSpecName: "util") pod "f8c83141-0e58-46e0-b507-db5b605d3af3" (UID: "f8c83141-0e58-46e0-b507-db5b605d3af3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:42.585047 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.585012    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:42.585047 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.585042    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8c83141-0e58-46e0-b507-db5b605d3af3-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:42.585047 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:42.585052    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsns2\" (UniqueName: \"kubernetes.io/projected/f8c83141-0e58-46e0-b507-db5b605d3af3-kube-api-access-dsns2\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:43.240721 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:43.240636    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:43.241080 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:43.241066    2563 scope.go:117] "RemoveContainer" containerID="361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d"
May 28 18:33:43.241246 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:33:43.241229    2563 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-nbmc2_opendatahub(1360dfcd-d4f8-4d45-840d-6671f8ba4de7)\"" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" podUID="1360dfcd-d4f8-4d45-840d-6671f8ba4de7"
May 28 18:33:43.291629 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:43.291599    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9"
May 28 18:33:43.291777 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:43.291601    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fw5b9" event={"ID":"f8c83141-0e58-46e0-b507-db5b605d3af3","Type":"ContainerDied","Data":"74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611"}
May 28 18:33:43.291777 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:43.291708    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74924e9b5d9572add7864cf274d9467a819806591aeaab7c51a75617a33e0611"
May 28 18:33:50.616799 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.616762    2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:50.617247 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.617160    2563 scope.go:117] "RemoveContainer" containerID="361451756cc7d1156aeb5165599e42b20dcb318b341153be70df3b6d47a3c14d"
May 28 18:33:50.980939 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.980864    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"]
May 28 18:33:50.981122 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981111    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="util"
May 28 18:33:50.981162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981124    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="util"
May 28 18:33:50.981162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981132    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="pull"
May 28 18:33:50.981162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981138    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="pull"
May 28 18:33:50.981162 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981158    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="extract"
May 28 18:33:50.981278 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981164    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="extract"
May 28 18:33:50.981278 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.981208    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="f8c83141-0e58-46e0-b507-db5b605d3af3" containerName="extract"
May 28 18:33:50.982889 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.982873    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:50.987488 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.987457    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
May 28 18:33:50.987638 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.987618    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xqr58\""
May 28 18:33:50.997008 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:50.996987    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
May 28 18:33:51.013954 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.013928    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"]
May 28 18:33:51.049212 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.049186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.049349 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.049239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wprwt\" (UniqueName: \"kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.049394 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.049357    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.150167 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.150121    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.150366 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.150193    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wprwt\" (UniqueName: \"kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.150366 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.150247    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.150684 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.150659    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.150773 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.150748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.166537 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.166507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wprwt\" (UniqueName: \"kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.291705 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.291628    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:51.318627 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.318593    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2" event={"ID":"1360dfcd-d4f8-4d45-840d-6671f8ba4de7","Type":"ContainerStarted","Data":"e4d61e0de1e027473460d2c1e59eec6c9be32d9ce5c886232de4167bcd571d0c"}
May 28 18:33:51.318886 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.318806    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:33:51.471005 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:51.470965    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"]
May 28 18:33:51.474586 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:51.474545    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77fbfe73_609e_4f76_9562_f1575e73afe5.slice/crio-e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a WatchSource:0}: Error finding container e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a: Status 404 returned error can't find the container with id e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a
May 28 18:33:52.192413 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.192379    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"]
May 28 18:33:52.194650 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.194629    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.197233 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.197210    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 28 18:33:52.197338 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.197232    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 28 18:33:52.197495 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.197470    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-5zlvw\""
May 28 18:33:52.208627 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.208605    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"]
May 28 18:33:52.259395 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.259350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b396254f-16d8-4d7e-a5a9-fc7864c5554f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.259577 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.259425    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k6r8\" (UniqueName: \"kubernetes.io/projected/b396254f-16d8-4d7e-a5a9-fc7864c5554f-kube-api-access-2k6r8\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.323401 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.323364    2563 generic.go:358] "Generic (PLEG): container finished" podID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerID="72d2dd7aa5b2181f53e4d856c89f490c4638c0795dbecb29b6b60eb48599ea36" exitCode=0
May 28 18:33:52.323589 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.323457    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w" event={"ID":"77fbfe73-609e-4f76-9562-f1575e73afe5","Type":"ContainerDied","Data":"72d2dd7aa5b2181f53e4d856c89f490c4638c0795dbecb29b6b60eb48599ea36"}
May 28 18:33:52.323589 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.323494    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w" event={"ID":"77fbfe73-609e-4f76-9562-f1575e73afe5","Type":"ContainerStarted","Data":"e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a"}
May 28 18:33:52.360318 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.360271    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b396254f-16d8-4d7e-a5a9-fc7864c5554f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.360492 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.360378    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2k6r8\" (UniqueName: \"kubernetes.io/projected/b396254f-16d8-4d7e-a5a9-fc7864c5554f-kube-api-access-2k6r8\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.363070 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.363042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/b396254f-16d8-4d7e-a5a9-fc7864c5554f-operator-config\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.369192 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.369167    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k6r8\" (UniqueName: \"kubernetes.io/projected/b396254f-16d8-4d7e-a5a9-fc7864c5554f-kube-api-access-2k6r8\") pod \"servicemesh-operator3-55f49c5f94-dk55b\" (UID: \"b396254f-16d8-4d7e-a5a9-fc7864c5554f\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.503658 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.503554    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:33:52.644366 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:52.644340    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"]
May 28 18:33:52.646803 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:33:52.646770    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb396254f_16d8_4d7e_a5a9_fc7864c5554f.slice/crio-cee552bf17d39c7f0d8bf62dec895dac191b00f4bd1ccb654c4f5d2ea6eef615 WatchSource:0}: Error finding container cee552bf17d39c7f0d8bf62dec895dac191b00f4bd1ccb654c4f5d2ea6eef615: Status 404 returned error can't find the container with id cee552bf17d39c7f0d8bf62dec895dac191b00f4bd1ccb654c4f5d2ea6eef615
May 28 18:33:53.328269 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:53.328229    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b" event={"ID":"b396254f-16d8-4d7e-a5a9-fc7864c5554f","Type":"ContainerStarted","Data":"cee552bf17d39c7f0d8bf62dec895dac191b00f4bd1ccb654c4f5d2ea6eef615"}
May 28 18:33:53.330278 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:53.330252    2563 generic.go:358] "Generic (PLEG): container finished" podID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerID="8a5655cf4249eec126c71884e4699cf6cce704a132c7b44499d87a1672b8a55e" exitCode=0
May 28 18:33:53.330385 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:53.330297    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w" event={"ID":"77fbfe73-609e-4f76-9562-f1575e73afe5","Type":"ContainerDied","Data":"8a5655cf4249eec126c71884e4699cf6cce704a132c7b44499d87a1672b8a55e"}
May 28 18:33:54.334857 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:54.334825    2563 generic.go:358] "Generic (PLEG): container finished" podID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerID="26f3461f15c24fc7d4eaa0ff35ddec8fffbeefbadfdcc8f677cb071da9544aae" exitCode=0
May 28 18:33:54.335237 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:54.334919    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w" event={"ID":"77fbfe73-609e-4f76-9562-f1575e73afe5","Type":"ContainerDied","Data":"26f3461f15c24fc7d4eaa0ff35ddec8fffbeefbadfdcc8f677cb071da9544aae"}
May 28 18:33:55.478425 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.478402    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:33:55.586797 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.586762    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle\") pod \"77fbfe73-609e-4f76-9562-f1575e73afe5\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") "
May 28 18:33:55.586954 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.586815    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util\") pod \"77fbfe73-609e-4f76-9562-f1575e73afe5\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") "
May 28 18:33:55.586954 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.586863    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wprwt\" (UniqueName: \"kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt\") pod \"77fbfe73-609e-4f76-9562-f1575e73afe5\" (UID: \"77fbfe73-609e-4f76-9562-f1575e73afe5\") "
May 28 18:33:55.587723 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.587692    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle" (OuterVolumeSpecName: "bundle") pod "77fbfe73-609e-4f76-9562-f1575e73afe5" (UID: "77fbfe73-609e-4f76-9562-f1575e73afe5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:55.588918 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.588895    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt" (OuterVolumeSpecName: "kube-api-access-wprwt") pod "77fbfe73-609e-4f76-9562-f1575e73afe5" (UID: "77fbfe73-609e-4f76-9562-f1575e73afe5"). InnerVolumeSpecName "kube-api-access-wprwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:33:55.593945 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.593925    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util" (OuterVolumeSpecName: "util") pod "77fbfe73-609e-4f76-9562-f1575e73afe5" (UID: "77fbfe73-609e-4f76-9562-f1575e73afe5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:33:55.687510 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.687472    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-bundle\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:55.687510 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.687508    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/77fbfe73-609e-4f76-9562-f1575e73afe5-util\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:55.687698 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:55.687523    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wprwt\" (UniqueName: \"kubernetes.io/projected/77fbfe73-609e-4f76-9562-f1575e73afe5-kube-api-access-wprwt\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:33:56.343219 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:56.343187    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w" event={"ID":"77fbfe73-609e-4f76-9562-f1575e73afe5","Type":"ContainerDied","Data":"e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a"}
May 28 18:33:56.343219 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:56.343221    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e13793d446e87c66a6e107037b488dd0d12d80b6c662213aedf235f1a9e1b31a"
May 28 18:33:56.343463 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:33:56.343231    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762ahs79w"
May 28 18:34:02.326031 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:02.325993    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-nbmc2"
May 28 18:34:03.371080 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:03.370191    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b" event={"ID":"b396254f-16d8-4d7e-a5a9-fc7864c5554f","Type":"ContainerStarted","Data":"839f9d967a8cb4d356ce0c331173924f99cc6dd1c16f7a7020478b6ced6b9fd2"}
May 28 18:34:03.371080 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:03.371039    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:34:03.394400 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:03.394338    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b" podStartSLOduration=0.827784607 podStartE2EDuration="11.394289468s" podCreationTimestamp="2026-05-28 18:33:52 +0000 UTC" firstStartedPulling="2026-05-28 18:33:52.649353475 +0000 UTC m=+504.268120439" lastFinishedPulling="2026-05-28 18:34:03.215858334 +0000 UTC m=+514.834625300" observedRunningTime="2026-05-28 18:34:03.39235591 +0000 UTC m=+515.011122890" watchObservedRunningTime="2026-05-28 18:34:03.394289468 +0000 UTC m=+515.013056452"
May 28 18:34:04.161621 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161575    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"]
May 28 18:34:04.161891 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161878    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="util"
May 28 18:34:04.161943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161893    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="util"
May 28 18:34:04.161943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161902    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="extract"
May 28 18:34:04.161943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161908    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="extract"
May 28 18:34:04.161943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161914    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="pull"
May 28 18:34:04.161943 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161921    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="pull"
May 28 18:34:04.162078 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.161967    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="77fbfe73-609e-4f76-9562-f1575e73afe5" containerName="extract"
May 28 18:34:04.163674 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.163657    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.166261 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.166219    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 28 18:34:04.166261 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.166262    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 28 18:34:04.166457 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.166268    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 28 18:34:04.166457 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.166222    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 28 18:34:04.166457 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.166228    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gglmv\""
May 28 18:34:04.176831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.176802    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"]
May 28 18:34:04.251660 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-cacerts\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.251840 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.251840 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzfhj\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-kube-api-access-lzfhj\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.251840 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7599dca3-2ebd-4900-9771-c5d848a9b1da-local-certs\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.251840 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.252007 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-token\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.252007 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.251890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.352995 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.352950    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-token\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.352995 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353000    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353249 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353031    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-cacerts\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353249 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353075    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353249 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353097    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzfhj\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-kube-api-access-lzfhj\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353249 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353135    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7599dca3-2ebd-4900-9771-c5d848a9b1da-local-certs\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353249 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353174    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.353812 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.353779    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.355706 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.355656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-cacerts\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.355970 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.355942    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.355970 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.355970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7599dca3-2ebd-4900-9771-c5d848a9b1da-local-certs\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.356132 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.355949    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.361004 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.360980    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-istio-token\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.361107 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.361089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzfhj\" (UniqueName: \"kubernetes.io/projected/7599dca3-2ebd-4900-9771-c5d848a9b1da-kube-api-access-lzfhj\") pod \"istiod-openshift-gateway-798958bb55-j9z67\" (UID: \"7599dca3-2ebd-4900-9771-c5d848a9b1da\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.476036 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.475748    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:04.621664 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:04.621634    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"]
May 28 18:34:04.623529 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:34:04.623496    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7599dca3_2ebd_4900_9771_c5d848a9b1da.slice/crio-cfaeca2f94af281ac92672a681e2f5e3bb5e938f7b9e0d07b307b1e4b7359dc3 WatchSource:0}: Error finding container cfaeca2f94af281ac92672a681e2f5e3bb5e938f7b9e0d07b307b1e4b7359dc3: Status 404 returned error can't find the container with id cfaeca2f94af281ac92672a681e2f5e3bb5e938f7b9e0d07b307b1e4b7359dc3
May 28 18:34:05.381387 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:05.381348    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67" event={"ID":"7599dca3-2ebd-4900-9771-c5d848a9b1da","Type":"ContainerStarted","Data":"cfaeca2f94af281ac92672a681e2f5e3bb5e938f7b9e0d07b307b1e4b7359dc3"}
May 28 18:34:07.306079 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:07.306034    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 18:34:07.306357 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:07.306107    2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
May 28 18:34:07.389858 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:07.389822    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67" event={"ID":"7599dca3-2ebd-4900-9771-c5d848a9b1da","Type":"ContainerStarted","Data":"67b8e3139abcb094f36a25ca60169f752155d86866ee877c78cc279d76444c23"}
May 28 18:34:07.390010 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:07.389977    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:07.416617 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:07.416535    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67" podStartSLOduration=0.736337619 podStartE2EDuration="3.416522077s" podCreationTimestamp="2026-05-28 18:34:04 +0000 UTC" firstStartedPulling="2026-05-28 18:34:04.625612169 +0000 UTC m=+516.244379129" lastFinishedPulling="2026-05-28 18:34:07.305796626 +0000 UTC m=+518.924563587" observedRunningTime="2026-05-28 18:34:07.416175277 +0000 UTC m=+519.034942260" watchObservedRunningTime="2026-05-28 18:34:07.416522077 +0000 UTC m=+519.035289059"
May 28 18:34:08.394215 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:08.394183    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-j9z67 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 28 18:34:08.394593 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:08.394244    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67" podUID="7599dca3-2ebd-4900-9771-c5d848a9b1da" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 28 18:34:11.393684 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:11.393653    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-j9z67"
May 28 18:34:12.291531 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:12.291500    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-fdvs5"
May 28 18:34:15.384003 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:34:15.383972    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:35:03.158669 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.158619    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"]
May 28 18:35:03.161642 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.161625    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:03.164264 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.164242    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 18:35:03.164371 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.164245    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xs76p\""
May 28 18:35:03.165069 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.165054    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 18:35:03.171193 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.171168    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"]
May 28 18:35:03.210932 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.210893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6s2\" (UniqueName: \"kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2\") pod \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" (UID: \"77bf74af-f284-42f6-919e-da039f61acba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:03.312301 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.312264    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6s2\" (UniqueName: \"kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2\") pod \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" (UID: \"77bf74af-f284-42f6-919e-da039f61acba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:03.320526 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.320498    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6s2\" (UniqueName: \"kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2\") pod \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" (UID: \"77bf74af-f284-42f6-919e-da039f61acba\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:03.472697 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.472605    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:03.631134 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:03.631105    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"]
May 28 18:35:03.634192 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:03.634157    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bf74af_f284_42f6_919e_da039f61acba.slice/crio-5955ef5b9e8303d2fbc0b0bc569612d4c3d0eb59a01f5cf9efc6e8b7458e98a0 WatchSource:0}: Error finding container 5955ef5b9e8303d2fbc0b0bc569612d4c3d0eb59a01f5cf9efc6e8b7458e98a0: Status 404 returned error can't find the container with id 5955ef5b9e8303d2fbc0b0bc569612d4c3d0eb59a01f5cf9efc6e8b7458e98a0
May 28 18:35:04.579632 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:04.579598    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" event={"ID":"77bf74af-f284-42f6-919e-da039f61acba","Type":"ContainerStarted","Data":"5955ef5b9e8303d2fbc0b0bc569612d4c3d0eb59a01f5cf9efc6e8b7458e98a0"}
May 28 18:35:05.584601 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:05.584554    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" event={"ID":"77bf74af-f284-42f6-919e-da039f61acba","Type":"ContainerStarted","Data":"340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89"}
May 28 18:35:05.584978 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:05.584658    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:05.606336 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:05.606282    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" podStartSLOduration=0.990054537 podStartE2EDuration="2.606269068s" podCreationTimestamp="2026-05-28 18:35:03 +0000 UTC" firstStartedPulling="2026-05-28 18:35:03.636043219 +0000 UTC m=+575.254810180" lastFinishedPulling="2026-05-28 18:35:05.252257742 +0000 UTC m=+576.871024711" observedRunningTime="2026-05-28 18:35:05.605160222 +0000 UTC m=+577.223927196" watchObservedRunningTime="2026-05-28 18:35:05.606269068 +0000 UTC m=+577.225036050"
May 28 18:35:09.129380 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.129338    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"]
May 28 18:35:09.132626 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.132609    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:09.134959 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.134936    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 28 18:35:09.135089 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.134939    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cf64p\""
May 28 18:35:09.142947 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.142925    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"]
May 28 18:35:09.263036 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.262996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj5kz\" (UniqueName: \"kubernetes.io/projected/120680bf-181f-45d7-ae89-794d6bcd38e0-kube-api-access-lj5kz\") pod \"dns-operator-controller-manager-648d5c98bc-spg9w\" (UID: \"120680bf-181f-45d7-ae89-794d6bcd38e0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:09.364283 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.364247    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj5kz\" (UniqueName: \"kubernetes.io/projected/120680bf-181f-45d7-ae89-794d6bcd38e0-kube-api-access-lj5kz\") pod \"dns-operator-controller-manager-648d5c98bc-spg9w\" (UID: \"120680bf-181f-45d7-ae89-794d6bcd38e0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:09.377174 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.377143    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj5kz\" (UniqueName: \"kubernetes.io/projected/120680bf-181f-45d7-ae89-794d6bcd38e0-kube-api-access-lj5kz\") pod \"dns-operator-controller-manager-648d5c98bc-spg9w\" (UID: \"120680bf-181f-45d7-ae89-794d6bcd38e0\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:09.443117 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.443032    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:09.587201 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.587175    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"]
May 28 18:35:09.589417 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:09.589385    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120680bf_181f_45d7_ae89_794d6bcd38e0.slice/crio-d06fdb399ae2c3da760f534678fd854174f05eb1466f4870fed40ea9f1663bcd WatchSource:0}: Error finding container d06fdb399ae2c3da760f534678fd854174f05eb1466f4870fed40ea9f1663bcd: Status 404 returned error can't find the container with id d06fdb399ae2c3da760f534678fd854174f05eb1466f4870fed40ea9f1663bcd
May 28 18:35:09.599903 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:09.599874    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w" event={"ID":"120680bf-181f-45d7-ae89-794d6bcd38e0","Type":"ContainerStarted","Data":"d06fdb399ae2c3da760f534678fd854174f05eb1466f4870fed40ea9f1663bcd"}
May 28 18:35:11.608656 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:11.608613    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w" event={"ID":"120680bf-181f-45d7-ae89-794d6bcd38e0","Type":"ContainerStarted","Data":"4632c5107281a26033b4598fe5935337128f89de01582a202f1956baf4af5998"}
May 28 18:35:11.609091 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:11.608743    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:11.627659 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:11.627596    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w" podStartSLOduration=0.910238316 podStartE2EDuration="2.627576133s" podCreationTimestamp="2026-05-28 18:35:09 +0000 UTC" firstStartedPulling="2026-05-28 18:35:09.591488642 +0000 UTC m=+581.210255609" lastFinishedPulling="2026-05-28 18:35:11.308826463 +0000 UTC m=+582.927593426" observedRunningTime="2026-05-28 18:35:11.625765344 +0000 UTC m=+583.244532329" watchObservedRunningTime="2026-05-28 18:35:11.627576133 +0000 UTC m=+583.246343115"
May 28 18:35:16.591145 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:16.591115    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:19.072985 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.072950    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"]
May 28 18:35:19.076207 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.076179    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.078736 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.078714    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kdvk5\""
May 28 18:35:19.093536 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.093511    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"]
May 28 18:35:19.145487 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.145449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.145681 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.145517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqdwv\" (UniqueName: \"kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.246132 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.246091    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.246278 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.246168    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqdwv\" (UniqueName: \"kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.246476 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.246456    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.264929 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.264897    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqdwv\" (UniqueName: \"kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv\") pod \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.386071 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.386019    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:19.512205 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.512170    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"]
May 28 18:35:19.516233 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:19.516207    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fa26a33_efed_4b75_b7d5_dc2475003f76.slice/crio-348af08a91d628588f248c82da015e1bb0f10fbf23c7fc80819d01a57ba1f0ac WatchSource:0}: Error finding container 348af08a91d628588f248c82da015e1bb0f10fbf23c7fc80819d01a57ba1f0ac: Status 404 returned error can't find the container with id 348af08a91d628588f248c82da015e1bb0f10fbf23c7fc80819d01a57ba1f0ac
May 28 18:35:19.538246 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.538218    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"]
May 28 18:35:19.550445 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.550419    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"]
May 28 18:35:19.559811 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.559783    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:19.564427 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.564402    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"]
May 28 18:35:19.564676 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.564655    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" podUID="77bf74af-f284-42f6-919e-da039f61acba" containerName="manager" containerID="cri-o://340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89" gracePeriod=2
May 28 18:35:19.564729 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.564675    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.570452 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.570273    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"]
May 28 18:35:19.577413 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.577383    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:19.578013 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.577839    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:19.588263 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.588239    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"]
May 28 18:35:19.588521 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.588510    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bf74af-f284-42f6-919e-da039f61acba" containerName="manager"
May 28 18:35:19.588588 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.588523    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bf74af-f284-42f6-919e-da039f61acba" containerName="manager"
May 28 18:35:19.588631 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.588596    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="77bf74af-f284-42f6-919e-da039f61acba" containerName="manager"
May 28 18:35:19.591429 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.591408    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:19.599817 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.599794    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"]
May 28 18:35:19.603199 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.603161    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:19.650071 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.650046    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhzq4\" (UniqueName: \"kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.650185 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.650093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.751265 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.751129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wpcw\" (UniqueName: \"kubernetes.io/projected/5d73ba85-d551-4ca7-ab73-be3688665b24-kube-api-access-7wpcw\") pod \"limitador-operator-controller-manager-85c4996f8c-b8wjb\" (UID: \"5d73ba85-d551-4ca7-ab73-be3688665b24\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:19.751265 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.751205    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nhzq4\" (UniqueName: \"kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.751265 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.751265    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.751715 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.751677    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.766609 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.766586    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhzq4\" (UniqueName: \"kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4\") pod \"kuadrant-operator-controller-manager-84b657d985-tdkvh\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.784966 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.784946    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:19.787082 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.787057    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:19.852033 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.851996    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf6s2\" (UniqueName: \"kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2\") pod \"77bf74af-f284-42f6-919e-da039f61acba\" (UID: \"77bf74af-f284-42f6-919e-da039f61acba\") "
May 28 18:35:19.852181 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.852139    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wpcw\" (UniqueName: \"kubernetes.io/projected/5d73ba85-d551-4ca7-ab73-be3688665b24-kube-api-access-7wpcw\") pod \"limitador-operator-controller-manager-85c4996f8c-b8wjb\" (UID: \"5d73ba85-d551-4ca7-ab73-be3688665b24\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:19.854135 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.854110    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2" (OuterVolumeSpecName: "kube-api-access-bf6s2") pod "77bf74af-f284-42f6-919e-da039f61acba" (UID: "77bf74af-f284-42f6-919e-da039f61acba"). InnerVolumeSpecName "kube-api-access-bf6s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:19.860804 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.860783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wpcw\" (UniqueName: \"kubernetes.io/projected/5d73ba85-d551-4ca7-ab73-be3688665b24-kube-api-access-7wpcw\") pod \"limitador-operator-controller-manager-85c4996f8c-b8wjb\" (UID: \"5d73ba85-d551-4ca7-ab73-be3688665b24\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:19.943908 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.943824    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:19.949633 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.949605    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:19.953634 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:19.953612    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf6s2\" (UniqueName: \"kubernetes.io/projected/77bf74af-f284-42f6-919e-da039f61acba-kube-api-access-bf6s2\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:35:20.131530 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.131458    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:20.133720 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.133692    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"]
May 28 18:35:20.168153 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:20.168123    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d73ba85_d551_4ca7_ab73_be3688665b24.slice/crio-f73262588ffa15c14e45cc48b4599146485d32f7f691443b79e7a32a7b27a453 WatchSource:0}: Error finding container f73262588ffa15c14e45cc48b4599146485d32f7f691443b79e7a32a7b27a453: Status 404 returned error can't find the container with id f73262588ffa15c14e45cc48b4599146485d32f7f691443b79e7a32a7b27a453
May 28 18:35:20.170826 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:20.170798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b60030_1cdb_45fd_938c_819bca3ed745.slice/crio-bf9a2d4ee76fb899292ae0de592039b9965527ca7305ca297e234d504c0fe3f0 WatchSource:0}: Error finding container bf9a2d4ee76fb899292ae0de592039b9965527ca7305ca297e234d504c0fe3f0: Status 404 returned error can't find the container with id bf9a2d4ee76fb899292ae0de592039b9965527ca7305ca297e234d504c0fe3f0
May 28 18:35:20.642781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.642736    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" event={"ID":"b4b60030-1cdb-45fd-938c-819bca3ed745","Type":"ContainerStarted","Data":"bf9a2d4ee76fb899292ae0de592039b9965527ca7305ca297e234d504c0fe3f0"}
May 28 18:35:20.644315 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.644279    2563 generic.go:358] "Generic (PLEG): container finished" podID="77bf74af-f284-42f6-919e-da039f61acba" containerID="340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89" exitCode=0
May 28 18:35:20.644444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.644376    2563 scope.go:117] "RemoveContainer" containerID="340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89"
May 28 18:35:20.644509 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.644486    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw"
May 28 18:35:20.646550 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.646523    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb" event={"ID":"5d73ba85-d551-4ca7-ab73-be3688665b24","Type":"ContainerStarted","Data":"0c551ec23b81760809ea06e4e9e06b70669511244544708cc631abc722bd94ea"}
May 28 18:35:20.646670 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.646593    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb" event={"ID":"5d73ba85-d551-4ca7-ab73-be3688665b24","Type":"ContainerStarted","Data":"f73262588ffa15c14e45cc48b4599146485d32f7f691443b79e7a32a7b27a453"}
May 28 18:35:20.646670 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.646631    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:20.647123 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.647095    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:20.649081 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.649041    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:20.658823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.658425    2563 scope.go:117] "RemoveContainer" containerID="340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89"
May 28 18:35:20.660105 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:35:20.658839    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89\": container with ID starting with 340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89 not found: ID does not exist" containerID="340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89"
May 28 18:35:20.660105 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.658874    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89"} err="failed to get container status \"340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89\": rpc error: code = NotFound desc = could not find container \"340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89\": container with ID starting with 340ec3624af7db42a511aae2f560803d7f8e73e946ebec89392b67bdb8f20f89 not found: ID does not exist"
May 28 18:35:20.677814 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.677770    2563 status_manager.go:895] "Failed to get status for pod" podUID="77bf74af-f284-42f6-919e-da039f61acba" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-hg5lw" err="pods \"limitador-operator-controller-manager-85c4996f8c-hg5lw\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:20.679045 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.678992    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb" podStartSLOduration=1.678975523 podStartE2EDuration="1.678975523s" podCreationTimestamp="2026-05-28 18:35:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:20.675917493 +0000 UTC m=+592.294684478" watchObservedRunningTime="2026-05-28 18:35:20.678975523 +0000 UTC m=+592.297742506"
May 28 18:35:20.893688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:20.893642    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bf74af-f284-42f6-919e-da039f61acba" path="/var/lib/kubelet/pods/77bf74af-f284-42f6-919e-da039f61acba/volumes"
May 28 18:35:22.614320 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:22.614289    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-spg9w"
May 28 18:35:24.666137 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:24.666098    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" containerName="manager" containerID="cri-o://2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9" gracePeriod=2
May 28 18:35:24.667608 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:24.667586    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" event={"ID":"b4b60030-1cdb-45fd-938c-819bca3ed745","Type":"ContainerStarted","Data":"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"}
May 28 18:35:24.667683 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:24.667633    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:24.691021 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:24.690977    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" podStartSLOduration=2.207791492 podStartE2EDuration="5.690962139s" podCreationTimestamp="2026-05-28 18:35:19 +0000 UTC" firstStartedPulling="2026-05-28 18:35:20.172998137 +0000 UTC m=+591.791765098" lastFinishedPulling="2026-05-28 18:35:23.656168785 +0000 UTC m=+595.274935745" observedRunningTime="2026-05-28 18:35:24.689009225 +0000 UTC m=+596.307776209" watchObservedRunningTime="2026-05-28 18:35:24.690962139 +0000 UTC m=+596.309729121"
May 28 18:35:24.893168 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:24.893145    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:25.001191 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.001115    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqdwv\" (UniqueName: \"kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv\") pod \"4fa26a33-efed-4b75-b7d5-dc2475003f76\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") "
May 28 18:35:25.001336 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.001200    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume\") pod \"4fa26a33-efed-4b75-b7d5-dc2475003f76\" (UID: \"4fa26a33-efed-4b75-b7d5-dc2475003f76\") "
May 28 18:35:25.001473 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.001453    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fa26a33-efed-4b75-b7d5-dc2475003f76" (UID: "4fa26a33-efed-4b75-b7d5-dc2475003f76"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:25.003217 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.003187    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv" (OuterVolumeSpecName: "kube-api-access-tqdwv") pod "4fa26a33-efed-4b75-b7d5-dc2475003f76" (UID: "4fa26a33-efed-4b75-b7d5-dc2475003f76"). InnerVolumeSpecName "kube-api-access-tqdwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:25.102509 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.102480    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fa26a33-efed-4b75-b7d5-dc2475003f76-extensions-socket-volume\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:35:25.102509 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.102507    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqdwv\" (UniqueName: \"kubernetes.io/projected/4fa26a33-efed-4b75-b7d5-dc2475003f76-kube-api-access-tqdwv\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:35:25.672304 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.672269    2563 generic.go:358] "Generic (PLEG): container finished" podID="4fa26a33-efed-4b75-b7d5-dc2475003f76" containerID="2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9" exitCode=2
May 28 18:35:25.672749 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.672319    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4"
May 28 18:35:25.672749 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.672372    2563 scope.go:117] "RemoveContainer" containerID="2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9"
May 28 18:35:25.674470 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.674439    2563 status_manager.go:895] "Failed to get status for pod" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4" err="pods \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:25.680947 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.680931    2563 scope.go:117] "RemoveContainer" containerID="2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9"
May 28 18:35:25.681189 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:35:25.681169    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9\": container with ID starting with 2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9 not found: ID does not exist" containerID="2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9"
May 28 18:35:25.681250 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.681201    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9"} err="failed to get container status \"2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9\": rpc error: code = NotFound desc = could not find container \"2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9\": container with ID starting with 2b2fa1fb204b0e39ce6a505ce0e81fbc15b06182e1eefdfa9079e74950ed9ed9 not found: ID does not exist"
May 28 18:35:25.691456 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:25.691425    2563 status_manager.go:895] "Failed to get status for pod" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-sc6l4" err="pods \"kuadrant-operator-controller-manager-84b657d985-sc6l4\" is forbidden: User \"system:node:ip-10-0-133-168.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-168.ec2.internal' and this object"
May 28 18:35:26.890656 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:26.890624    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" path="/var/lib/kubelet/pods/4fa26a33-efed-4b75-b7d5-dc2475003f76/volumes"
May 28 18:35:31.654810 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:31.654768    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-b8wjb"
May 28 18:35:35.674820 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.674775    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:35.953207 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.953132    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:35:35.953422 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.953410    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" containerName="manager"
May 28 18:35:35.953473 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.953423    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" containerName="manager"
May 28 18:35:35.953509 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.953486    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="4fa26a33-efed-4b75-b7d5-dc2475003f76" containerName="manager"
May 28 18:35:35.958515 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.958493    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:35.973596 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:35.973548    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:35:36.092925 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.092888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fc9\" (UniqueName: \"kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.093124 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.093006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.193864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.193811    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.193864 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.193871    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-74fc9\" (UniqueName: \"kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.194241 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.194218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.207818 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.207748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fc9\" (UniqueName: \"kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wzd94\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.267956 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.267924    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.396485 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.396458    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:35:36.398612 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:36.398559    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763bfb9f_f144_4884_8c9a_06e7d9f23a43.slice/crio-966748220c5c505164270723915fc16ab1a0fc929981e3bc17b5787a2431825d WatchSource:0}: Error finding container 966748220c5c505164270723915fc16ab1a0fc929981e3bc17b5787a2431825d: Status 404 returned error can't find the container with id 966748220c5c505164270723915fc16ab1a0fc929981e3bc17b5787a2431825d
May 28 18:35:36.716847 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.716806    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerStarted","Data":"f113419279ab7e915372262b23e94a7b5997268242d25a988e8d16b776f5e91c"}
May 28 18:35:36.716847 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.716849    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerStarted","Data":"966748220c5c505164270723915fc16ab1a0fc929981e3bc17b5787a2431825d"}
May 28 18:35:36.717264 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.716883    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:36.738308 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:36.738262    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" podStartSLOduration=1.738247412 podStartE2EDuration="1.738247412s" podCreationTimestamp="2026-05-28 18:35:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:35:36.736421096 +0000 UTC m=+608.355188081" watchObservedRunningTime="2026-05-28 18:35:36.738247412 +0000 UTC m=+608.357014395"
May 28 18:35:47.722906 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:47.722872    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:35:47.773758 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:47.773722    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:47.774071 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:47.774040    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" podUID="b4b60030-1cdb-45fd-938c-819bca3ed745" containerName="manager" containerID="cri-o://9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee" gracePeriod=10
May 28 18:35:48.006895 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.006870    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:48.088080 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.088029    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhzq4\" (UniqueName: \"kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4\") pod \"b4b60030-1cdb-45fd-938c-819bca3ed745\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") "
May 28 18:35:48.088294 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.088127    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume\") pod \"b4b60030-1cdb-45fd-938c-819bca3ed745\" (UID: \"b4b60030-1cdb-45fd-938c-819bca3ed745\") "
May 28 18:35:48.088483 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.088459    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b4b60030-1cdb-45fd-938c-819bca3ed745" (UID: "b4b60030-1cdb-45fd-938c-819bca3ed745"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:35:48.090133 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.090106    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4" (OuterVolumeSpecName: "kube-api-access-nhzq4") pod "b4b60030-1cdb-45fd-938c-819bca3ed745" (UID: "b4b60030-1cdb-45fd-938c-819bca3ed745"). InnerVolumeSpecName "kube-api-access-nhzq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:35:48.188878 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.188840    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhzq4\" (UniqueName: \"kubernetes.io/projected/b4b60030-1cdb-45fd-938c-819bca3ed745-kube-api-access-nhzq4\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:35:48.188878 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.188869    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4b60030-1cdb-45fd-938c-819bca3ed745-extensions-socket-volume\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:35:48.759925 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.759886    2563 generic.go:358] "Generic (PLEG): container finished" podID="b4b60030-1cdb-45fd-938c-819bca3ed745" containerID="9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee" exitCode=0
May 28 18:35:48.760388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.759945    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" event={"ID":"b4b60030-1cdb-45fd-938c-819bca3ed745","Type":"ContainerDied","Data":"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"}
May 28 18:35:48.760388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.759961    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"
May 28 18:35:48.760388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.759980    2563 scope.go:117] "RemoveContainer" containerID="9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"
May 28 18:35:48.760388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.759971    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh" event={"ID":"b4b60030-1cdb-45fd-938c-819bca3ed745","Type":"ContainerDied","Data":"bf9a2d4ee76fb899292ae0de592039b9965527ca7305ca297e234d504c0fe3f0"}
May 28 18:35:48.768309 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.768293    2563 scope.go:117] "RemoveContainer" containerID="9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"
May 28 18:35:48.768586 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:35:48.768544    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee\": container with ID starting with 9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee not found: ID does not exist" containerID="9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"
May 28 18:35:48.768638 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.768595    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee"} err="failed to get container status \"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee\": rpc error: code = NotFound desc = could not find container \"9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee\": container with ID starting with 9a558e3298e274660c678bd27610c51239f844d4376ea741bc46b0ec995353ee not found: ID does not exist"
May 28 18:35:48.793964 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.793928    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:48.805023 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.804998    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-tdkvh"]
May 28 18:35:48.890666 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:48.890637    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4b60030-1cdb-45fd-938c-819bca3ed745" path="/var/lib/kubelet/pods/b4b60030-1cdb-45fd-938c-819bca3ed745/volumes"
May 28 18:35:57.004072 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.004032    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:35:57.004455 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.004348    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4b60030-1cdb-45fd-938c-819bca3ed745" containerName="manager"
May 28 18:35:57.004455 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.004360    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4b60030-1cdb-45fd-938c-819bca3ed745" containerName="manager"
May 28 18:35:57.004455 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.004409    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="b4b60030-1cdb-45fd-938c-819bca3ed745" containerName="manager"
May 28 18:35:57.040169 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.040136    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:35:57.040339 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.040247    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:35:57.043017 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.042993    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nnwdw\""
May 28 18:35:57.065846 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.065816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpv9f\" (UniqueName: \"kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f\") pod \"authorino-7498df8756-8gxxz\" (UID: \"413cef9f-fe84-4106-a4dd-89da8296aaaf\") " pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:35:57.166429 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.166393    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpv9f\" (UniqueName: \"kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f\") pod \"authorino-7498df8756-8gxxz\" (UID: \"413cef9f-fe84-4106-a4dd-89da8296aaaf\") " pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:35:57.173907 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.173877    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpv9f\" (UniqueName: \"kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f\") pod \"authorino-7498df8756-8gxxz\" (UID: \"413cef9f-fe84-4106-a4dd-89da8296aaaf\") " pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:35:57.349669 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.349631    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:35:57.474331 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.474306    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:35:57.476729 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:35:57.476704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413cef9f_fe84_4106_a4dd_89da8296aaaf.slice/crio-b427e1215a3719f41bfe5dbe943523d54beff87b07561d02a815bd872cac43d6 WatchSource:0}: Error finding container b427e1215a3719f41bfe5dbe943523d54beff87b07561d02a815bd872cac43d6: Status 404 returned error can't find the container with id b427e1215a3719f41bfe5dbe943523d54beff87b07561d02a815bd872cac43d6
May 28 18:35:57.791774 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:35:57.791678    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8gxxz" event={"ID":"413cef9f-fe84-4106-a4dd-89da8296aaaf","Type":"ContainerStarted","Data":"b427e1215a3719f41bfe5dbe943523d54beff87b07561d02a815bd872cac43d6"}
May 28 18:36:00.807884 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:00.807851    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8gxxz" event={"ID":"413cef9f-fe84-4106-a4dd-89da8296aaaf","Type":"ContainerStarted","Data":"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"}
May 28 18:36:00.822067 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:00.822023    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-8gxxz" podStartSLOduration=2.129465085 podStartE2EDuration="4.822010901s" podCreationTimestamp="2026-05-28 18:35:56 +0000 UTC" firstStartedPulling="2026-05-28 18:35:57.477890791 +0000 UTC m=+629.096657752" lastFinishedPulling="2026-05-28 18:36:00.170436607 +0000 UTC m=+631.789203568" observedRunningTime="2026-05-28 18:36:00.820197328 +0000 UTC m=+632.438964313" watchObservedRunningTime="2026-05-28 18:36:00.822010901 +0000 UTC m=+632.440777885"
May 28 18:36:32.622598 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.622543    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:36:32.622999 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.622777    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-8gxxz" podUID="413cef9f-fe84-4106-a4dd-89da8296aaaf" containerName="authorino" containerID="cri-o://0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440" gracePeriod=30
May 28 18:36:32.874613 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.874534    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:36:32.919306 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.919274    2563 generic.go:358] "Generic (PLEG): container finished" podID="413cef9f-fe84-4106-a4dd-89da8296aaaf" containerID="0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440" exitCode=0
May 28 18:36:32.919465 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.919324    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-8gxxz"
May 28 18:36:32.919465 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.919360    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8gxxz" event={"ID":"413cef9f-fe84-4106-a4dd-89da8296aaaf","Type":"ContainerDied","Data":"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"}
May 28 18:36:32.919465 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.919394    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-8gxxz" event={"ID":"413cef9f-fe84-4106-a4dd-89da8296aaaf","Type":"ContainerDied","Data":"b427e1215a3719f41bfe5dbe943523d54beff87b07561d02a815bd872cac43d6"}
May 28 18:36:32.919465 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.919409    2563 scope.go:117] "RemoveContainer" containerID="0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"
May 28 18:36:32.927336 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.927317    2563 scope.go:117] "RemoveContainer" containerID="0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"
May 28 18:36:32.927597 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:36:32.927576    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440\": container with ID starting with 0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440 not found: ID does not exist" containerID="0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"
May 28 18:36:32.927660 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:32.927606    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440"} err="failed to get container status \"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440\": rpc error: code = NotFound desc = could not find container \"0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440\": container with ID starting with 0e953688737638b6ad386f74bc81642ed301c10b168a4d0f245665f5c401e440 not found: ID does not exist"
May 28 18:36:33.056248 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:33.056210    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpv9f\" (UniqueName: \"kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f\") pod \"413cef9f-fe84-4106-a4dd-89da8296aaaf\" (UID: \"413cef9f-fe84-4106-a4dd-89da8296aaaf\") "
May 28 18:36:33.058230 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:33.058200    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f" (OuterVolumeSpecName: "kube-api-access-bpv9f") pod "413cef9f-fe84-4106-a4dd-89da8296aaaf" (UID: "413cef9f-fe84-4106-a4dd-89da8296aaaf"). InnerVolumeSpecName "kube-api-access-bpv9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:33.157729 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:33.157647    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpv9f\" (UniqueName: \"kubernetes.io/projected/413cef9f-fe84-4106-a4dd-89da8296aaaf-kube-api-access-bpv9f\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:36:33.244143 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:33.244113    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:36:33.245688 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:33.245668    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-8gxxz"]
May 28 18:36:34.895332 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:34.895296    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413cef9f-fe84-4106-a4dd-89da8296aaaf" path="/var/lib/kubelet/pods/413cef9f-fe84-4106-a4dd-89da8296aaaf/volumes"
May 28 18:36:35.720670 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.720637    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:35.720937 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.720926    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413cef9f-fe84-4106-a4dd-89da8296aaaf" containerName="authorino"
May 28 18:36:35.720981 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.720939    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="413cef9f-fe84-4106-a4dd-89da8296aaaf" containerName="authorino"
May 28 18:36:35.721019 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.720993    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="413cef9f-fe84-4106-a4dd-89da8296aaaf" containerName="authorino"
May 28 18:36:35.725620 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.725599    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.728181 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.728151    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
May 28 18:36:35.728403 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.728386    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 18:36:35.728988 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.728824    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lb7dw\""
May 28 18:36:35.730457 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.730416    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:35.872831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.872792    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:36:35.875753 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.875732    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:35.879278 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.879257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qd4q\" (UniqueName: \"kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.879377 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.879291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.883067 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.883043    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:36:35.979724 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.979641    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qd4q\" (UniqueName: \"kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.979724 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.979682    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.980100 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.979739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:35.980100 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.979767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95k9\" (UniqueName: \"kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:35.982107 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.982089    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:35.986738 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:35.986712    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qd4q\" (UniqueName: \"kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q\") pod \"maas-controller-6b8dbb54f4-8nkp8\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") " pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:36.037264 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.037229    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:36.080266 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.080229    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:36.080422 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.080279    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b95k9\" (UniqueName: \"kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:36.082743 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.082723    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:36.088222 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.088193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95k9\" (UniqueName: \"kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9\") pod \"maas-controller-64dcb8994-7hn9r\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") " pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:36.187041 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.187010    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:36.191391 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.191368    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:36.194536 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:36:36.194510    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeccf8183_9300_4577_81d2_2a5b14ec69fb.slice/crio-40fbe710cea47231185d0df8a72c9cdd17ab05094d2c9e8dda80be43012749e6 WatchSource:0}: Error finding container 40fbe710cea47231185d0df8a72c9cdd17ab05094d2c9e8dda80be43012749e6: Status 404 returned error can't find the container with id 40fbe710cea47231185d0df8a72c9cdd17ab05094d2c9e8dda80be43012749e6
May 28 18:36:36.309342 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.309319    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:36:36.310748 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:36:36.310713    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a49141b_064d_42bc_a4eb_afda661af0a1.slice/crio-7d77e3abe0bd311c92969d38ee1231e71907b61dcc9c472e364bade14d92cf0e WatchSource:0}: Error finding container 7d77e3abe0bd311c92969d38ee1231e71907b61dcc9c472e364bade14d92cf0e: Status 404 returned error can't find the container with id 7d77e3abe0bd311c92969d38ee1231e71907b61dcc9c472e364bade14d92cf0e
May 28 18:36:36.939839 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.939774    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" event={"ID":"eccf8183-9300-4577-81d2-2a5b14ec69fb","Type":"ContainerStarted","Data":"40fbe710cea47231185d0df8a72c9cdd17ab05094d2c9e8dda80be43012749e6"}
May 28 18:36:36.941937 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:36.941875    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-7hn9r" event={"ID":"9a49141b-064d-42bc-a4eb-afda661af0a1","Type":"ContainerStarted","Data":"7d77e3abe0bd311c92969d38ee1231e71907b61dcc9c472e364bade14d92cf0e"}
May 28 18:36:38.951356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.951263    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" event={"ID":"eccf8183-9300-4577-81d2-2a5b14ec69fb","Type":"ContainerStarted","Data":"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"}
May 28 18:36:38.951356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.951310    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:38.953047 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.953014    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-7hn9r" event={"ID":"9a49141b-064d-42bc-a4eb-afda661af0a1","Type":"ContainerStarted","Data":"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"}
May 28 18:36:38.953166 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.953115    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:38.969171 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.969128    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" podStartSLOduration=1.351174676 podStartE2EDuration="3.969113107s" podCreationTimestamp="2026-05-28 18:36:35 +0000 UTC" firstStartedPulling="2026-05-28 18:36:36.195761826 +0000 UTC m=+667.814528791" lastFinishedPulling="2026-05-28 18:36:38.813700261 +0000 UTC m=+670.432467222" observedRunningTime="2026-05-28 18:36:38.96649957 +0000 UTC m=+670.585266554" watchObservedRunningTime="2026-05-28 18:36:38.969113107 +0000 UTC m=+670.587880089"
May 28 18:36:38.987377 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:38.987325    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-64dcb8994-7hn9r" podStartSLOduration=1.475233889 podStartE2EDuration="3.987310351s" podCreationTimestamp="2026-05-28 18:36:35 +0000 UTC" firstStartedPulling="2026-05-28 18:36:36.312044041 +0000 UTC m=+667.930811003" lastFinishedPulling="2026-05-28 18:36:38.824120495 +0000 UTC m=+670.442887465" observedRunningTime="2026-05-28 18:36:38.983874547 +0000 UTC m=+670.602641531" watchObservedRunningTime="2026-05-28 18:36:38.987310351 +0000 UTC m=+670.606077333"
May 28 18:36:49.962326 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:49.962290    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:49.962700 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:49.962553    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:36:50.015556 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.015522    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:50.015807 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.015767    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" podUID="eccf8183-9300-4577-81d2-2a5b14ec69fb" containerName="manager" containerID="cri-o://30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e" gracePeriod=30
May 28 18:36:50.254977 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.254955    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:50.280203 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.280166    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qd4q\" (UniqueName: \"kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q\") pod \"eccf8183-9300-4577-81d2-2a5b14ec69fb\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") "
May 28 18:36:50.280353 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.280261    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert\") pod \"eccf8183-9300-4577-81d2-2a5b14ec69fb\" (UID: \"eccf8183-9300-4577-81d2-2a5b14ec69fb\") "
May 28 18:36:50.282316 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.282289    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "eccf8183-9300-4577-81d2-2a5b14ec69fb" (UID: "eccf8183-9300-4577-81d2-2a5b14ec69fb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:36:50.282316 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.282302    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q" (OuterVolumeSpecName: "kube-api-access-9qd4q") pod "eccf8183-9300-4577-81d2-2a5b14ec69fb" (UID: "eccf8183-9300-4577-81d2-2a5b14ec69fb"). InnerVolumeSpecName "kube-api-access-9qd4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:36:50.380781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.380751    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qd4q\" (UniqueName: \"kubernetes.io/projected/eccf8183-9300-4577-81d2-2a5b14ec69fb-kube-api-access-9qd4q\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:36:50.380781 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.380779    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eccf8183-9300-4577-81d2-2a5b14ec69fb-webhook-cert\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:36:50.994720 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.994684    2563 generic.go:358] "Generic (PLEG): container finished" podID="eccf8183-9300-4577-81d2-2a5b14ec69fb" containerID="30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e" exitCode=0
May 28 18:36:50.994720 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.994715    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" event={"ID":"eccf8183-9300-4577-81d2-2a5b14ec69fb","Type":"ContainerDied","Data":"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"}
May 28 18:36:50.995195 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.994750    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8"
May 28 18:36:50.995195 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.994771    2563 scope.go:117] "RemoveContainer" containerID="30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"
May 28 18:36:50.995195 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:50.994752    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b8dbb54f4-8nkp8" event={"ID":"eccf8183-9300-4577-81d2-2a5b14ec69fb","Type":"ContainerDied","Data":"40fbe710cea47231185d0df8a72c9cdd17ab05094d2c9e8dda80be43012749e6"}
May 28 18:36:51.002985 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:51.002967    2563 scope.go:117] "RemoveContainer" containerID="30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"
May 28 18:36:51.003236 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:36:51.003217    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e\": container with ID starting with 30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e not found: ID does not exist" containerID="30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"
May 28 18:36:51.003281 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:51.003244    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e"} err="failed to get container status \"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e\": rpc error: code = NotFound desc = could not find container \"30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e\": container with ID starting with 30e7830518b4af0a53d785f7a4fd1b6de070c9f26546d179a1949910c1e0d61e not found: ID does not exist"
May 28 18:36:51.009701 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:51.009681    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:51.013462 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:51.013441    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6b8dbb54f4-8nkp8"]
May 28 18:36:52.890846 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:36:52.890812    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eccf8183-9300-4577-81d2-2a5b14ec69fb" path="/var/lib/kubelet/pods/eccf8183-9300-4577-81d2-2a5b14ec69fb/volumes"
May 28 18:37:10.134065 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.134028    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69fdff467b-jngkt"]
May 28 18:37:10.134483 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.134317    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eccf8183-9300-4577-81d2-2a5b14ec69fb" containerName="manager"
May 28 18:37:10.134483 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.134329    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="eccf8183-9300-4577-81d2-2a5b14ec69fb" containerName="manager"
May 28 18:37:10.134483 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.134389    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="eccf8183-9300-4577-81d2-2a5b14ec69fb" containerName="manager"
May 28 18:37:10.138495 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.138474    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.141363 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.141343    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 28 18:37:10.141476 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.141341    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-q9jh6\""
May 28 18:37:10.146698 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.146674    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69fdff467b-jngkt"]
May 28 18:37:10.223697 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.223662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4x2w\" (UniqueName: \"kubernetes.io/projected/72d09eaf-8d89-4c97-b357-39e55f820f6d-kube-api-access-b4x2w\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.223881 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.223728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72d09eaf-8d89-4c97-b357-39e55f820f6d-maas-api-tls\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.324828 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.324792    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72d09eaf-8d89-4c97-b357-39e55f820f6d-maas-api-tls\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.324998 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.324849    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x2w\" (UniqueName: \"kubernetes.io/projected/72d09eaf-8d89-4c97-b357-39e55f820f6d-kube-api-access-b4x2w\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.327155 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.327136    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/72d09eaf-8d89-4c97-b357-39e55f820f6d-maas-api-tls\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.333042 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.333014    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4x2w\" (UniqueName: \"kubernetes.io/projected/72d09eaf-8d89-4c97-b357-39e55f820f6d-kube-api-access-b4x2w\") pod \"maas-api-69fdff467b-jngkt\" (UID: \"72d09eaf-8d89-4c97-b357-39e55f820f6d\") " pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.450138 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.450057    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:10.581203 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.581136    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69fdff467b-jngkt"]
May 28 18:37:10.583830 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:37:10.583793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d09eaf_8d89_4c97_b357_39e55f820f6d.slice/crio-931d793e5d17e940179054dcf43a5869d8b1dfe5ce5c719bc45d451776dea03b WatchSource:0}: Error finding container 931d793e5d17e940179054dcf43a5869d8b1dfe5ce5c719bc45d451776dea03b: Status 404 returned error can't find the container with id 931d793e5d17e940179054dcf43a5869d8b1dfe5ce5c719bc45d451776dea03b
May 28 18:37:10.585213 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:10.585193    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:37:11.067319 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:11.067280    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69fdff467b-jngkt" event={"ID":"72d09eaf-8d89-4c97-b357-39e55f820f6d","Type":"ContainerStarted","Data":"931d793e5d17e940179054dcf43a5869d8b1dfe5ce5c719bc45d451776dea03b"}
May 28 18:37:13.076059 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:13.076018    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69fdff467b-jngkt" event={"ID":"72d09eaf-8d89-4c97-b357-39e55f820f6d","Type":"ContainerStarted","Data":"008c2d303bb9f7eed584073aa87f76e10f72331b686d14d4dd27d10a6965d67b"}
May 28 18:37:13.076519 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:13.076070    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:13.092748 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:13.092695    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-69fdff467b-jngkt" podStartSLOduration=1.464516245 podStartE2EDuration="3.092679705s" podCreationTimestamp="2026-05-28 18:37:10 +0000 UTC" firstStartedPulling="2026-05-28 18:37:10.585319473 +0000 UTC m=+702.204086435" lastFinishedPulling="2026-05-28 18:37:12.213482932 +0000 UTC m=+703.832249895" observedRunningTime="2026-05-28 18:37:13.090735049 +0000 UTC m=+704.709502031" watchObservedRunningTime="2026-05-28 18:37:13.092679705 +0000 UTC m=+704.711446688"
May 28 18:37:19.085426 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:19.085351    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69fdff467b-jngkt"
May 28 18:37:44.084973 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.084941    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"]
May 28 18:37:44.087982 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.087965    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.091178 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.091153    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 18:37:44.091178 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.091166    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qms9\""
May 28 18:37:44.091347 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.091189    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 18:37:44.091347 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.091166    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 18:37:44.098604 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.098585    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"]
May 28 18:37:44.198678 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.198881 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.198881 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.198881 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198800    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88ww\" (UniqueName: \"kubernetes.io/projected/ba25b02f-45b2-417f-a750-7bd659a11ba7-kube-api-access-d88ww\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.199000 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.199000 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.198931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba25b02f-45b2-417f-a750-7bd659a11ba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.299659 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299620    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.299659 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299661    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.299908 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299680    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.299908 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299795    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d88ww\" (UniqueName: \"kubernetes.io/projected/ba25b02f-45b2-417f-a750-7bd659a11ba7-kube-api-access-d88ww\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.299908 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299898    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.300064 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.299928    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba25b02f-45b2-417f-a750-7bd659a11ba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.300146 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.300127    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.300210 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.300162    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.300251 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.300210    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.302064 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.302044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba25b02f-45b2-417f-a750-7bd659a11ba7-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.302307 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.302291    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba25b02f-45b2-417f-a750-7bd659a11ba7-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.306823 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.306794    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88ww\" (UniqueName: \"kubernetes.io/projected/ba25b02f-45b2-417f-a750-7bd659a11ba7-kube-api-access-d88ww\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692\" (UID: \"ba25b02f-45b2-417f-a750-7bd659a11ba7\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.399136 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.399056    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:44.536710 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:44.536627    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"]
May 28 18:37:44.539369 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:37:44.539344    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba25b02f_45b2_417f_a750_7bd659a11ba7.slice/crio-33761cb355425262a4844466ee8fad7d10b863a9a32d0d6132f8bf83bde5823b WatchSource:0}: Error finding container 33761cb355425262a4844466ee8fad7d10b863a9a32d0d6132f8bf83bde5823b: Status 404 returned error can't find the container with id 33761cb355425262a4844466ee8fad7d10b863a9a32d0d6132f8bf83bde5823b
May 28 18:37:45.186803 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:45.186759    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692" event={"ID":"ba25b02f-45b2-417f-a750-7bd659a11ba7","Type":"ContainerStarted","Data":"33761cb355425262a4844466ee8fad7d10b863a9a32d0d6132f8bf83bde5823b"}
May 28 18:37:50.207110 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:50.207018    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692" event={"ID":"ba25b02f-45b2-417f-a750-7bd659a11ba7","Type":"ContainerStarted","Data":"71e589b7248103989c12b40b784df1336c1c40e3726fa563c04fa155b3f898a2"}
May 28 18:37:56.229102 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:56.229062    2563 generic.go:358] "Generic (PLEG): container finished" podID="ba25b02f-45b2-417f-a750-7bd659a11ba7" containerID="71e589b7248103989c12b40b784df1336c1c40e3726fa563c04fa155b3f898a2" exitCode=0
May 28 18:37:56.229590 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:56.229128    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692" event={"ID":"ba25b02f-45b2-417f-a750-7bd659a11ba7","Type":"ContainerDied","Data":"71e589b7248103989c12b40b784df1336c1c40e3726fa563c04fa155b3f898a2"}
May 28 18:37:58.238216 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:58.238179    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692" event={"ID":"ba25b02f-45b2-417f-a750-7bd659a11ba7","Type":"ContainerStarted","Data":"f0cd7f1ae7b2389b33321b84f77f2fdc2533ec1ea17a534518261d91c6972ac9"}
May 28 18:37:58.238615 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:58.238396    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:37:58.255888 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:37:58.255842    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692" podStartSLOduration=1.509650795 podStartE2EDuration="14.255827256s" podCreationTimestamp="2026-05-28 18:37:44 +0000 UTC" firstStartedPulling="2026-05-28 18:37:44.542445474 +0000 UTC m=+736.161212440" lastFinishedPulling="2026-05-28 18:37:57.288621939 +0000 UTC m=+748.907388901" observedRunningTime="2026-05-28 18:37:58.254100156 +0000 UTC m=+749.872867140" watchObservedRunningTime="2026-05-28 18:37:58.255827256 +0000 UTC m=+749.874594239"
May 28 18:38:06.281379 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.281346    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"]
May 28 18:38:06.283979 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.283958    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.286307 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.286285    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 18:38:06.292687 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.292664    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"]
May 28 18:38:06.293021 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.292998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzrqs\" (UniqueName: \"kubernetes.io/projected/2b028948-6835-4526-b521-a5fc71dfcd2d-kube-api-access-qzrqs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.293104 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.293039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.293104 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.293079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.293197 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.293124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.293232 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.293207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.293305 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.293287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b028948-6835-4526-b521-a5fc71dfcd2d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.393664 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393634    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.393831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393677    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.393831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393716    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.393831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393755    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b028948-6835-4526-b521-a5fc71dfcd2d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.393831 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393788    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzrqs\" (UniqueName: \"kubernetes.io/projected/2b028948-6835-4526-b521-a5fc71dfcd2d-kube-api-access-qzrqs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.394026 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.393920    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.394158 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.394130    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.394285 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.394156    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.394285 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.394235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.395829 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.395801    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b028948-6835-4526-b521-a5fc71dfcd2d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.396117 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.396099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b028948-6835-4526-b521-a5fc71dfcd2d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.400606 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.400544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzrqs\" (UniqueName: \"kubernetes.io/projected/2b028948-6835-4526-b521-a5fc71dfcd2d-kube-api-access-qzrqs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd\" (UID: \"2b028948-6835-4526-b521-a5fc71dfcd2d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.577584 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.577518    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"]
May 28 18:38:06.580141 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.580115    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.582426 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.582405    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 18:38:06.588200 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.588175    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"]
May 28 18:38:06.594837 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.594816    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:06.595207 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.595261 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.595336 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.595437 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbj9\" (UniqueName: \"kubernetes.io/projected/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kube-api-access-mgbj9\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.595437 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.595437 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.595406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4b62a3-6dbf-4f5b-8360-fb110310654d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696595 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696545    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696616    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696657    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696673    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbj9\" (UniqueName: \"kubernetes.io/projected/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kube-api-access-mgbj9\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696698    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.696744 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696716    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4b62a3-6dbf-4f5b-8360-fb110310654d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.697009 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.696952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.697334 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.697288    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.697443 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.697335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.699351 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.699333    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b4b62a3-6dbf-4f5b-8360-fb110310654d-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.700309 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.700289    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b4b62a3-6dbf-4f5b-8360-fb110310654d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.705105 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.705082    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbj9\" (UniqueName: \"kubernetes.io/projected/5b4b62a3-6dbf-4f5b-8360-fb110310654d-kube-api-access-mgbj9\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb\" (UID: \"5b4b62a3-6dbf-4f5b-8360-fb110310654d\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:06.731682 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.731655    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"]
May 28 18:38:06.733266 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:38:06.733243    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b028948_6835_4526_b521_a5fc71dfcd2d.slice/crio-f0475c4ff616bdb1a35bd59d1a0bded2ff289f59f4ec9c54e855a5a7adc147bb WatchSource:0}: Error finding container f0475c4ff616bdb1a35bd59d1a0bded2ff289f59f4ec9c54e855a5a7adc147bb: Status 404 returned error can't find the container with id f0475c4ff616bdb1a35bd59d1a0bded2ff289f59f4ec9c54e855a5a7adc147bb
May 28 18:38:06.890076 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:06.890016    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:07.026876 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:07.026851    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"]
May 28 18:38:07.028380 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:38:07.028351    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4b62a3_6dbf_4f5b_8360_fb110310654d.slice/crio-19a07cad9e349592a669d5e52fd9e12370ba632eba5145ee0907b840663b8765 WatchSource:0}: Error finding container 19a07cad9e349592a669d5e52fd9e12370ba632eba5145ee0907b840663b8765: Status 404 returned error can't find the container with id 19a07cad9e349592a669d5e52fd9e12370ba632eba5145ee0907b840663b8765
May 28 18:38:07.272356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:07.272261    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb" event={"ID":"5b4b62a3-6dbf-4f5b-8360-fb110310654d","Type":"ContainerStarted","Data":"b68fcc557bda0cbf88380758c8cb119fa37d380cc7c60384f6d538031be8ff6e"}
May 28 18:38:07.272356 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:07.272315    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb" event={"ID":"5b4b62a3-6dbf-4f5b-8360-fb110310654d","Type":"ContainerStarted","Data":"19a07cad9e349592a669d5e52fd9e12370ba632eba5145ee0907b840663b8765"}
May 28 18:38:07.273815 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:07.273784    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd" event={"ID":"2b028948-6835-4526-b521-a5fc71dfcd2d","Type":"ContainerStarted","Data":"3fbc8480837abf685f1cf1239843d1b59b49195b552b2ae50cfec892546ed896"}
May 28 18:38:07.273919 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:07.273823    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd" event={"ID":"2b028948-6835-4526-b521-a5fc71dfcd2d","Type":"ContainerStarted","Data":"f0475c4ff616bdb1a35bd59d1a0bded2ff289f59f4ec9c54e855a5a7adc147bb"}
May 28 18:38:09.261875 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:09.261842    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692"
May 28 18:38:13.305634 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:13.305599    2563 generic.go:358] "Generic (PLEG): container finished" podID="2b028948-6835-4526-b521-a5fc71dfcd2d" containerID="3fbc8480837abf685f1cf1239843d1b59b49195b552b2ae50cfec892546ed896" exitCode=0
May 28 18:38:13.305992 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:13.305670    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd" event={"ID":"2b028948-6835-4526-b521-a5fc71dfcd2d","Type":"ContainerDied","Data":"3fbc8480837abf685f1cf1239843d1b59b49195b552b2ae50cfec892546ed896"}
May 28 18:38:14.312858 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:14.312814    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd" event={"ID":"2b028948-6835-4526-b521-a5fc71dfcd2d","Type":"ContainerStarted","Data":"f6210218b99119cd42d7349bd1b21074396d5318ce36d5e14cc0bac969a59c28"}
May 28 18:38:14.314297 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:14.313132    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:14.330383 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:14.330305    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd" podStartSLOduration=8.115031795 podStartE2EDuration="8.330290904s" podCreationTimestamp="2026-05-28 18:38:06 +0000 UTC" firstStartedPulling="2026-05-28 18:38:13.306609146 +0000 UTC m=+764.925376121" lastFinishedPulling="2026-05-28 18:38:13.521868256 +0000 UTC m=+765.140635230" observedRunningTime="2026-05-28 18:38:14.329310611 +0000 UTC m=+765.948077593" watchObservedRunningTime="2026-05-28 18:38:14.330290904 +0000 UTC m=+765.949057919"
May 28 18:38:15.317707 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:15.317676    2563 generic.go:358] "Generic (PLEG): container finished" podID="5b4b62a3-6dbf-4f5b-8360-fb110310654d" containerID="b68fcc557bda0cbf88380758c8cb119fa37d380cc7c60384f6d538031be8ff6e" exitCode=0
May 28 18:38:15.318043 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:15.317753    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb" event={"ID":"5b4b62a3-6dbf-4f5b-8360-fb110310654d","Type":"ContainerDied","Data":"b68fcc557bda0cbf88380758c8cb119fa37d380cc7c60384f6d538031be8ff6e"}
May 28 18:38:16.323637 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:16.323603    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb" event={"ID":"5b4b62a3-6dbf-4f5b-8360-fb110310654d","Type":"ContainerStarted","Data":"6c527964b12ca3808bb2df4dad1a1b2f28cf0ca27b63b3df72ab0b7845b04925"}
May 28 18:38:16.324044 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:16.323810    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:16.342657 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:16.342593    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb" podStartSLOduration=10.096673083 podStartE2EDuration="10.342553911s" podCreationTimestamp="2026-05-28 18:38:06 +0000 UTC" firstStartedPulling="2026-05-28 18:38:15.31845557 +0000 UTC m=+766.937222530" lastFinishedPulling="2026-05-28 18:38:15.564336396 +0000 UTC m=+767.183103358" observedRunningTime="2026-05-28 18:38:16.339115999 +0000 UTC m=+767.957882981" watchObservedRunningTime="2026-05-28 18:38:16.342553911 +0000 UTC m=+767.961320895"
May 28 18:38:25.331497 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:25.331465    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd"
May 28 18:38:27.339150 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.339116    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb"
May 28 18:38:27.581115 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.581078    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"]
May 28 18:38:27.603768 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.603692    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"]
May 28 18:38:27.603894 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.603879    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.606177 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.606158    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 18:38:27.677819 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.677778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.677987 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.677834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.677987 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.677912    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.677987 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.677958    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.677987 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.677979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxd2\" (UniqueName: \"kubernetes.io/projected/b27c7ec4-38bf-45be-8985-627ba601f224-kube-api-access-zqxd2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.678158 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.678028    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27c7ec4-38bf-45be-8985-627ba601f224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.778661 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778622    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.778852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778676    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.778852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778722    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.778852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778750    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxd2\" (UniqueName: \"kubernetes.io/projected/b27c7ec4-38bf-45be-8985-627ba601f224-kube-api-access-zqxd2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.778852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778798    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27c7ec4-38bf-45be-8985-627ba601f224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.779080 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.778889    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.779135 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.779091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.779416 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.779386    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.779527 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.779437    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.781125 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.781101    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b27c7ec4-38bf-45be-8985-627ba601f224-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.781316 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.781299    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b27c7ec4-38bf-45be-8985-627ba601f224-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.790128 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.790107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxd2\" (UniqueName: \"kubernetes.io/projected/b27c7ec4-38bf-45be-8985-627ba601f224-kube-api-access-zqxd2\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8\" (UID: \"b27c7ec4-38bf-45be-8985-627ba601f224\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:27.914438 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:27.914355    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:28.047555 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:28.047517    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"]
May 28 18:38:28.052594 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:38:28.052509    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb27c7ec4_38bf_45be_8985_627ba601f224.slice/crio-61200781c72aabb0b99d913efb44ff7280f2cf37429bf7c66a046306de42c991 WatchSource:0}: Error finding container 61200781c72aabb0b99d913efb44ff7280f2cf37429bf7c66a046306de42c991: Status 404 returned error can't find the container with id 61200781c72aabb0b99d913efb44ff7280f2cf37429bf7c66a046306de42c991
May 28 18:38:28.368626 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:28.368587    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8" event={"ID":"b27c7ec4-38bf-45be-8985-627ba601f224","Type":"ContainerStarted","Data":"b53807a7af520d6ee9b8ab1e3590ab094e6a10f503492bbb597f5a4facf45174"}
May 28 18:38:28.368626 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:28.368625    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8" event={"ID":"b27c7ec4-38bf-45be-8985-627ba601f224","Type":"ContainerStarted","Data":"61200781c72aabb0b99d913efb44ff7280f2cf37429bf7c66a046306de42c991"}
May 28 18:38:34.391499 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:34.391461    2563 generic.go:358] "Generic (PLEG): container finished" podID="b27c7ec4-38bf-45be-8985-627ba601f224" containerID="b53807a7af520d6ee9b8ab1e3590ab094e6a10f503492bbb597f5a4facf45174" exitCode=0
May 28 18:38:34.391942 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:34.391536    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8" event={"ID":"b27c7ec4-38bf-45be-8985-627ba601f224","Type":"ContainerDied","Data":"b53807a7af520d6ee9b8ab1e3590ab094e6a10f503492bbb597f5a4facf45174"}
May 28 18:38:35.396290 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:35.396257    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8" event={"ID":"b27c7ec4-38bf-45be-8985-627ba601f224","Type":"ContainerStarted","Data":"ebdfa65aa57294b36a02c4e3aff8ab88f5dfded28848346409703eba0c0dad18"}
May 28 18:38:35.396701 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:35.396463    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:38:35.414014 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:35.413968    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8" podStartSLOduration=8.204343056 podStartE2EDuration="8.413955871s" podCreationTimestamp="2026-05-28 18:38:27 +0000 UTC" firstStartedPulling="2026-05-28 18:38:34.392134026 +0000 UTC m=+786.010900988" lastFinishedPulling="2026-05-28 18:38:34.601746838 +0000 UTC m=+786.220513803" observedRunningTime="2026-05-28 18:38:35.411295441 +0000 UTC m=+787.030062425" watchObservedRunningTime="2026-05-28 18:38:35.413955871 +0000 UTC m=+787.032722872"
May 28 18:38:46.413125 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:38:46.413089    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8"
May 28 18:40:37.293287 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.293255    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:40:37.293929 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.293485    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-64dcb8994-7hn9r" podUID="9a49141b-064d-42bc-a4eb-afda661af0a1" containerName="manager" containerID="cri-o://6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5" gracePeriod=30
May 28 18:40:37.535738 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.535712    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:40:37.694604 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.694538    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b95k9\" (UniqueName: \"kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9\") pod \"9a49141b-064d-42bc-a4eb-afda661af0a1\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") "
May 28 18:40:37.694784 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.694642    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert\") pod \"9a49141b-064d-42bc-a4eb-afda661af0a1\" (UID: \"9a49141b-064d-42bc-a4eb-afda661af0a1\") "
May 28 18:40:37.696732 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.696697    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9" (OuterVolumeSpecName: "kube-api-access-b95k9") pod "9a49141b-064d-42bc-a4eb-afda661af0a1" (UID: "9a49141b-064d-42bc-a4eb-afda661af0a1"). InnerVolumeSpecName "kube-api-access-b95k9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:40:37.696834 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.696736    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9a49141b-064d-42bc-a4eb-afda661af0a1" (UID: "9a49141b-064d-42bc-a4eb-afda661af0a1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 18:40:37.796051 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.796015    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a49141b-064d-42bc-a4eb-afda661af0a1-webhook-cert\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:40:37.796051 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.796046    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b95k9\" (UniqueName: \"kubernetes.io/projected/9a49141b-064d-42bc-a4eb-afda661af0a1-kube-api-access-b95k9\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:40:37.841123 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.841083    2563 generic.go:358] "Generic (PLEG): container finished" podID="9a49141b-064d-42bc-a4eb-afda661af0a1" containerID="6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5" exitCode=0
May 28 18:40:37.841303 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.841185    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-7hn9r"
May 28 18:40:37.841303 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.841169    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-7hn9r" event={"ID":"9a49141b-064d-42bc-a4eb-afda661af0a1","Type":"ContainerDied","Data":"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"}
May 28 18:40:37.841388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.841315    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-7hn9r" event={"ID":"9a49141b-064d-42bc-a4eb-afda661af0a1","Type":"ContainerDied","Data":"7d77e3abe0bd311c92969d38ee1231e71907b61dcc9c472e364bade14d92cf0e"}
May 28 18:40:37.841388 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.841334    2563 scope.go:117] "RemoveContainer" containerID="6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"
May 28 18:40:37.850041 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.850018    2563 scope.go:117] "RemoveContainer" containerID="6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"
May 28 18:40:37.850294 ip-10-0-133-168 kubenswrapper[2563]: E0528 18:40:37.850270    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5\": container with ID starting with 6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5 not found: ID does not exist" containerID="6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"
May 28 18:40:37.850361 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.850303    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5"} err="failed to get container status \"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5\": rpc error: code = NotFound desc = could not find container \"6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5\": container with ID starting with 6e2338c45be2b8db4374c744d235190c5b27ae5c2be2dd9f1e15094ace6a41c5 not found: ID does not exist"
May 28 18:40:37.861842 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.861819    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:40:37.865822 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:37.865800    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64dcb8994-7hn9r"]
May 28 18:40:38.610021 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.609986    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64dcb8994-9sgnh"]
May 28 18:40:38.610392 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.610344    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a49141b-064d-42bc-a4eb-afda661af0a1" containerName="manager"
May 28 18:40:38.610392 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.610355    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a49141b-064d-42bc-a4eb-afda661af0a1" containerName="manager"
May 28 18:40:38.610467 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.610421    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a49141b-064d-42bc-a4eb-afda661af0a1" containerName="manager"
May 28 18:40:38.613120 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.613102    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.615384 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.615365    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 28 18:40:38.616211 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.616195    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-lb7dw\""
May 28 18:40:38.616277 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.616195    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
May 28 18:40:38.621730 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.621708    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64dcb8994-9sgnh"]
May 28 18:40:38.705883 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.705844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtvv5\" (UniqueName: \"kubernetes.io/projected/72697a89-45d4-43db-a3ea-a01a1b12fc3a-kube-api-access-jtvv5\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.706064 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.705972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72697a89-45d4-43db-a3ea-a01a1b12fc3a-webhook-cert\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.806654 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.806614    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72697a89-45d4-43db-a3ea-a01a1b12fc3a-webhook-cert\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.806853 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.806685    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtvv5\" (UniqueName: \"kubernetes.io/projected/72697a89-45d4-43db-a3ea-a01a1b12fc3a-kube-api-access-jtvv5\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.809116 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.809088    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72697a89-45d4-43db-a3ea-a01a1b12fc3a-webhook-cert\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.816510 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.816484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtvv5\" (UniqueName: \"kubernetes.io/projected/72697a89-45d4-43db-a3ea-a01a1b12fc3a-kube-api-access-jtvv5\") pod \"maas-controller-64dcb8994-9sgnh\" (UID: \"72697a89-45d4-43db-a3ea-a01a1b12fc3a\") " pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:38.890704 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.890632    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a49141b-064d-42bc-a4eb-afda661af0a1" path="/var/lib/kubelet/pods/9a49141b-064d-42bc-a4eb-afda661af0a1/volumes"
May 28 18:40:38.923780 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:38.923741    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:39.053579 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:39.053537    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64dcb8994-9sgnh"]
May 28 18:40:39.055740 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:40:39.055714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72697a89_45d4_43db_a3ea_a01a1b12fc3a.slice/crio-f43f1a5eb1c7e1a9abacff9c63593e4fe890634a30f9785d174437d163d5f522 WatchSource:0}: Error finding container f43f1a5eb1c7e1a9abacff9c63593e4fe890634a30f9785d174437d163d5f522: Status 404 returned error can't find the container with id f43f1a5eb1c7e1a9abacff9c63593e4fe890634a30f9785d174437d163d5f522
May 28 18:40:39.852070 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:39.851981    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-9sgnh" event={"ID":"72697a89-45d4-43db-a3ea-a01a1b12fc3a","Type":"ContainerStarted","Data":"b12fed8e5bd9170d50fbf68d98b2783ca531c0efc6522e1602acf838b3a11f63"}
May 28 18:40:39.852070 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:39.852023    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64dcb8994-9sgnh" event={"ID":"72697a89-45d4-43db-a3ea-a01a1b12fc3a","Type":"ContainerStarted","Data":"f43f1a5eb1c7e1a9abacff9c63593e4fe890634a30f9785d174437d163d5f522"}
May 28 18:40:39.852444 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:39.852080    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:40:39.869625 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:39.869581    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-64dcb8994-9sgnh" podStartSLOduration=1.325072392 podStartE2EDuration="1.869556809s" podCreationTimestamp="2026-05-28 18:40:38 +0000 UTC" firstStartedPulling="2026-05-28 18:40:39.057538273 +0000 UTC m=+910.676305248" lastFinishedPulling="2026-05-28 18:40:39.6020227 +0000 UTC m=+911.220789665" observedRunningTime="2026-05-28 18:40:39.867220089 +0000 UTC m=+911.485987071" watchObservedRunningTime="2026-05-28 18:40:39.869556809 +0000 UTC m=+911.488323792"
May 28 18:40:50.860937 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:40:50.860902    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64dcb8994-9sgnh"
May 28 18:46:16.060852 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:16.060815    2563 generic.go:358] "Generic (PLEG): container finished" podID="b396254f-16d8-4d7e-a5a9-fc7864c5554f" containerID="839f9d967a8cb4d356ce0c331173924f99cc6dd1c16f7a7020478b6ced6b9fd2" exitCode=1
May 28 18:46:16.061369 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:16.060857    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b" event={"ID":"b396254f-16d8-4d7e-a5a9-fc7864c5554f","Type":"ContainerDied","Data":"839f9d967a8cb4d356ce0c331173924f99cc6dd1c16f7a7020478b6ced6b9fd2"}
May 28 18:46:16.061369 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:16.061280    2563 scope.go:117] "RemoveContainer" containerID="839f9d967a8cb4d356ce0c331173924f99cc6dd1c16f7a7020478b6ced6b9fd2"
May 28 18:46:16.062237 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:16.062222    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:46:17.066516 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.066478    2563 generic.go:358] "Generic (PLEG): container finished" podID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerID="f113419279ab7e915372262b23e94a7b5997268242d25a988e8d16b776f5e91c" exitCode=0
May 28 18:46:17.066969 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.066556    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerDied","Data":"f113419279ab7e915372262b23e94a7b5997268242d25a988e8d16b776f5e91c"}
May 28 18:46:17.066969 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.066934    2563 scope.go:117] "RemoveContainer" containerID="f113419279ab7e915372262b23e94a7b5997268242d25a988e8d16b776f5e91c"
May 28 18:46:17.068482 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.068415    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b" event={"ID":"b396254f-16d8-4d7e-a5a9-fc7864c5554f","Type":"ContainerStarted","Data":"a6d3148836fd5f4ede180b161303271b507a8da76cc442b7e93f1f5e364010b4"}
May 28 18:46:17.068637 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.068612    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:46:17.721492 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:17.721441    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:46:18.073974 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:18.073884    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerStarted","Data":"9bb80cc346adfc82c0a947b3b47dd7ab8638002a800289ecef8ac466db410dbc"}
May 28 18:46:19.077595 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:19.077551    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:46:28.075929 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:28.075899    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-dk55b"
May 28 18:46:30.082184 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:46:30.082149    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:51:26.057214 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.057123    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:51:26.057818 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.057452    2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager" containerID="cri-o://9bb80cc346adfc82c0a947b3b47dd7ab8638002a800289ecef8ac466db410dbc" gracePeriod=10
May 28 18:51:26.201616 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.201578    2563 generic.go:358] "Generic (PLEG): container finished" podID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerID="9bb80cc346adfc82c0a947b3b47dd7ab8638002a800289ecef8ac466db410dbc" exitCode=0
May 28 18:51:26.201767 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.201649    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerDied","Data":"9bb80cc346adfc82c0a947b3b47dd7ab8638002a800289ecef8ac466db410dbc"}
May 28 18:51:26.201767 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.201691    2563 scope.go:117] "RemoveContainer" containerID="f113419279ab7e915372262b23e94a7b5997268242d25a988e8d16b776f5e91c"
May 28 18:51:26.310481 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.310402    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:51:26.373210 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.373174    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74fc9\" (UniqueName: \"kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9\") pod \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") "
May 28 18:51:26.373372 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.373230    2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume\") pod \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\" (UID: \"763bfb9f-f144-4884-8c9a-06e7d9f23a43\") "
May 28 18:51:26.373634 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.373607    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "763bfb9f-f144-4884-8c9a-06e7d9f23a43" (UID: "763bfb9f-f144-4884-8c9a-06e7d9f23a43"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 18:51:26.375279 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.375257    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9" (OuterVolumeSpecName: "kube-api-access-74fc9") pod "763bfb9f-f144-4884-8c9a-06e7d9f23a43" (UID: "763bfb9f-f144-4884-8c9a-06e7d9f23a43"). InnerVolumeSpecName "kube-api-access-74fc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 18:51:26.474019 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.473977    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74fc9\" (UniqueName: \"kubernetes.io/projected/763bfb9f-f144-4884-8c9a-06e7d9f23a43-kube-api-access-74fc9\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:51:26.474019 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:26.474012    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/763bfb9f-f144-4884-8c9a-06e7d9f23a43-extensions-socket-volume\") on node \"ip-10-0-133-168.ec2.internal\" DevicePath \"\""
May 28 18:51:27.206056 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:27.205952    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94" event={"ID":"763bfb9f-f144-4884-8c9a-06e7d9f23a43","Type":"ContainerDied","Data":"966748220c5c505164270723915fc16ab1a0fc929981e3bc17b5787a2431825d"}
May 28 18:51:27.206056 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:27.206013    2563 scope.go:117] "RemoveContainer" containerID="9bb80cc346adfc82c0a947b3b47dd7ab8638002a800289ecef8ac466db410dbc"
May 28 18:51:27.206511 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:27.205977    2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"
May 28 18:51:27.223104 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:27.223076    2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:51:27.228785 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:27.228758    2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wzd94"]
May 28 18:51:28.891077 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:51:28.891037    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" path="/var/lib/kubelet/pods/763bfb9f-f144-4884-8c9a-06e7d9f23a43/volumes"
May 28 18:52:32.137602 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.137498    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"]
May 28 18:52:32.138144 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.138036    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 18:52:32.138144 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.138061    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 18:52:32.138270 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.138227    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 18:52:32.141129 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.141112    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.146082 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.146061    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kdvk5\""
May 28 18:52:32.154613 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.154586    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"]
May 28 18:52:32.230515 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.230456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7261209f-bf90-46f2-b6b1-7d008d1eee78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.230732 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.230540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25cr\" (UniqueName: \"kubernetes.io/projected/7261209f-bf90-46f2-b6b1-7d008d1eee78-kube-api-access-w25cr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.331416 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.331382    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7261209f-bf90-46f2-b6b1-7d008d1eee78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.331616 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.331434    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w25cr\" (UniqueName: \"kubernetes.io/projected/7261209f-bf90-46f2-b6b1-7d008d1eee78-kube-api-access-w25cr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.331784 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.331764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7261209f-bf90-46f2-b6b1-7d008d1eee78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.340491 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.340468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25cr\" (UniqueName: \"kubernetes.io/projected/7261209f-bf90-46f2-b6b1-7d008d1eee78-kube-api-access-w25cr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-j4c9c\" (UID: \"7261209f-bf90-46f2-b6b1-7d008d1eee78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.450346 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.450263    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:32.590149 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.590127    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"]
May 28 18:52:32.592480 ip-10-0-133-168 kubenswrapper[2563]: W0528 18:52:32.592451    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7261209f_bf90_46f2_b6b1_7d008d1eee78.slice/crio-5a6316638fbe3af0fe81b5e778166c432089eec5935b6ab3c73a1f2aff63fe68 WatchSource:0}: Error finding container 5a6316638fbe3af0fe81b5e778166c432089eec5935b6ab3c73a1f2aff63fe68: Status 404 returned error can't find the container with id 5a6316638fbe3af0fe81b5e778166c432089eec5935b6ab3c73a1f2aff63fe68
May 28 18:52:32.595342 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:32.595326    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 18:52:33.443624 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:33.443582    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c" event={"ID":"7261209f-bf90-46f2-b6b1-7d008d1eee78","Type":"ContainerStarted","Data":"72da1b4ffd32c7bddc489f54827a15a0f92f7a0308862139dd5bbcf47326539a"}
May 28 18:52:33.443991 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:33.443630    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c" event={"ID":"7261209f-bf90-46f2-b6b1-7d008d1eee78","Type":"ContainerStarted","Data":"5a6316638fbe3af0fe81b5e778166c432089eec5935b6ab3c73a1f2aff63fe68"}
May 28 18:52:33.443991 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:33.443696    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 18:52:33.464609 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:33.464532    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c" podStartSLOduration=1.464513142 podStartE2EDuration="1.464513142s" podCreationTimestamp="2026-05-28 18:52:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 18:52:33.463498476 +0000 UTC m=+1625.082265452" watchObservedRunningTime="2026-05-28 18:52:33.464513142 +0000 UTC m=+1625.083280127"
May 28 18:52:44.449176 ip-10-0-133-168 kubenswrapper[2563]: I0528 18:52:44.449136    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-j4c9c"
May 28 19:02:18.086879 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:18.086840    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-fdvs5_97caf7bc-1c64-4748-9f14-29d127c7bec5/manager/0.log"
May 28 19:02:18.212722 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:18.212688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69fdff467b-jngkt_72d09eaf-8d89-4c97-b357-39e55f820f6d/maas-api/0.log"
May 28 19:02:18.560738 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:18.560653    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64dcb8994-9sgnh_72697a89-45d4-43db-a3ea-a01a1b12fc3a/manager/0.log"
May 28 19:02:18.675989 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:18.675957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nbmc2_1360dfcd-d4f8-4d45-840d-6671f8ba4de7/manager/2.log"
May 28 19:02:18.792259 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:18.792223    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-7vh6d_9ab6f240-75a3-40a3-8282-38d2208c3c33/manager/0.log"
May 28 19:02:20.584389 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:20.584357    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-spg9w_120680bf-181f-45d7-ae89-794d6bcd38e0/manager/0.log"
May 28 19:02:20.937143 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:20.937066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-j4c9c_7261209f-bf90-46f2-b6b1-7d008d1eee78/manager/0.log"
May 28 19:02:21.177515 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:21.177483    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-b8wjb_5d73ba85-d551-4ca7-ab73-be3688665b24/manager/0.log"
May 28 19:02:21.621840 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:21.621803    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-j9z67_7599dca3-2ebd-4900-9771-c5d848a9b1da/discovery/0.log"
May 28 19:02:21.731856 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:21.731824    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d979fcbd5-f47tw_abbd8498-b8f1-423c-be58-cdffc4a96a9d/kube-auth-proxy/0.log"
May 28 19:02:22.535586 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.535538    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8_b27c7ec4-38bf-45be-8985-627ba601f224/storage-initializer/0.log"
May 28 19:02:22.543630 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.543607    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-jzhr8_b27c7ec4-38bf-45be-8985-627ba601f224/main/0.log"
May 28 19:02:22.657057 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.657027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692_ba25b02f-45b2-417f-a750-7bd659a11ba7/main/0.log"
May 28 19:02:22.663995 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.663975    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-s9692_ba25b02f-45b2-417f-a750-7bd659a11ba7/storage-initializer/0.log"
May 28 19:02:22.892904 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.892876    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd_2b028948-6835-4526-b521-a5fc71dfcd2d/storage-initializer/0.log"
May 28 19:02:22.900454 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:22.900431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccx9dpd_2b028948-6835-4526-b521-a5fc71dfcd2d/main/0.log"
May 28 19:02:23.116377 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:23.116348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb_5b4b62a3-6dbf-4f5b-8360-fb110310654d/storage-initializer/0.log"
May 28 19:02:23.123455 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:23.123432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-xt7rb_5b4b62a3-6dbf-4f5b-8360-fb110310654d/main/0.log"
May 28 19:02:30.372213 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:30.372176    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9t5lj_e0cb9cb1-2497-48d2-8544-7385e27a8468/global-pull-secret-syncer/0.log"
May 28 19:02:30.503180 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:30.503151    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4mljd_15d72bb3-b98a-402e-8e31-da72e5c96f6b/konnectivity-agent/0.log"
May 28 19:02:30.554488 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:30.554454    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-168.ec2.internal_325b5d6f3edda642a7db68c954fea7bb/haproxy/0.log"
May 28 19:02:34.944639 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:34.944611    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-spg9w_120680bf-181f-45d7-ae89-794d6bcd38e0/manager/0.log"
May 28 19:02:35.092297 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:35.092264    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-j4c9c_7261209f-bf90-46f2-b6b1-7d008d1eee78/manager/0.log"
May 28 19:02:35.211271 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:35.211195    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-b8wjb_5d73ba85-d551-4ca7-ab73-be3688665b24/manager/0.log"
May 28 19:02:37.084127 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:37.084098    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql2zz_cb046df9-0f78-49ab-838c-dfbe6146fb3a/node-exporter/0.log"
May 28 19:02:37.128418 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:37.128391    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql2zz_cb046df9-0f78-49ab-838c-dfbe6146fb3a/kube-rbac-proxy/0.log"
May 28 19:02:37.147130 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:37.147108    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ql2zz_cb046df9-0f78-49ab-838c-dfbe6146fb3a/init-textfile/0.log"
May 28 19:02:38.783846 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:38.783809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-7vbl8_ac45cf08-9a72-4348-9ce1-45664931e225/networking-console-plugin/0.log"
May 28 19:02:39.348684 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.348649    2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"]
May 28 19:02:39.349143 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.349119    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 19:02:39.349143 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.349144    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 19:02:39.349309 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.349262    2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="763bfb9f-f144-4884-8c9a-06e7d9f23a43" containerName="manager"
May 28 19:02:39.351301 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.351281    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.353708 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.353687    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"openshift-service-ca.crt\""
May 28 19:02:39.353708 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.353695    2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fx658\"/\"default-dockercfg-dz7nn\""
May 28 19:02:39.353880 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.353742    2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fx658\"/\"kube-root-ca.crt\""
May 28 19:02:39.361112 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.361091    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"]
May 28 19:02:39.407434 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.407408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-proc\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.407588 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.407456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-lib-modules\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.407588 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.407474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvp7\" (UniqueName: \"kubernetes.io/projected/0e0e39db-35e7-4c66-bb5f-a466ba740d61-kube-api-access-hpvp7\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.407588 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.407530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-podres\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.407708 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.407604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-sys\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508336 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508305    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-proc\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508474 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508349    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-lib-modules\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508474 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508414    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-proc\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508474 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508458    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-lib-modules\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508474 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508461    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvp7\" (UniqueName: \"kubernetes.io/projected/0e0e39db-35e7-4c66-bb5f-a466ba740d61-kube-api-access-hpvp7\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508638 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508504    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-podres\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508638 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508588    2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-sys\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508707 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508654    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-podres\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.508707 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.508682    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e0e39db-35e7-4c66-bb5f-a466ba740d61-sys\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.516116 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.516098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvp7\" (UniqueName: \"kubernetes.io/projected/0e0e39db-35e7-4c66-bb5f-a466ba740d61-kube-api-access-hpvp7\") pod \"perf-node-gather-daemonset-qhbj7\" (UID: \"0e0e39db-35e7-4c66-bb5f-a466ba740d61\") " pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.662088 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.662006    2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:39.789955 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.789920    2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"]
May 28 19:02:39.791235 ip-10-0-133-168 kubenswrapper[2563]: W0528 19:02:39.791212    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e0e39db_35e7_4c66_bb5f_a466ba740d61.slice/crio-120fbced04e01e1faa86aee96d83f6fa423c8b07ec2252fa99ca304d8d643af6 WatchSource:0}: Error finding container 120fbced04e01e1faa86aee96d83f6fa423c8b07ec2252fa99ca304d8d643af6: Status 404 returned error can't find the container with id 120fbced04e01e1faa86aee96d83f6fa423c8b07ec2252fa99ca304d8d643af6
May 28 19:02:39.792722 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:39.792704    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 19:02:40.697758 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:40.697719    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7" event={"ID":"0e0e39db-35e7-4c66-bb5f-a466ba740d61","Type":"ContainerStarted","Data":"8a13834029e3eb08b5e1637c336d35fb20632b93060d7bbac182855b47d0c44c"}
May 28 19:02:40.697758 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:40.697761    2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7" event={"ID":"0e0e39db-35e7-4c66-bb5f-a466ba740d61","Type":"ContainerStarted","Data":"120fbced04e01e1faa86aee96d83f6fa423c8b07ec2252fa99ca304d8d643af6"}
May 28 19:02:40.697978 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:40.697792    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:40.713821 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:40.713769    2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7" podStartSLOduration=1.71375338 podStartE2EDuration="1.71375338s" podCreationTimestamp="2026-05-28 19:02:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 19:02:40.712896659 +0000 UTC m=+2232.331663643" watchObservedRunningTime="2026-05-28 19:02:40.71375338 +0000 UTC m=+2232.332520362"
May 28 19:02:41.080086 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:41.080059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7k75k_6d23005a-e9cd-491b-9b06-a93fe60cb0bc/dns/0.log"
May 28 19:02:41.100624 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:41.100596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7k75k_6d23005a-e9cd-491b-9b06-a93fe60cb0bc/kube-rbac-proxy/0.log"
May 28 19:02:41.292043 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:41.292016    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zzxvm_5a7baa17-0558-4e1b-8905-a03070dc5514/dns-node-resolver/0.log"
May 28 19:02:41.764515 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:41.764485    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6m2zp_be20f7e5-caed-4be7-a16e-7006ca321b07/node-ca/0.log"
May 28 19:02:42.730694 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:42.730665    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-j9z67_7599dca3-2ebd-4900-9771-c5d848a9b1da/discovery/0.log"
May 28 19:02:42.750168 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:42.750136    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d979fcbd5-f47tw_abbd8498-b8f1-423c-be58-cdffc4a96a9d/kube-auth-proxy/0.log"
May 28 19:02:43.468369 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:43.468336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w8dbq_991b67c7-ef9c-4fde-bf3f-601c61ecbbd3/serve-healthcheck-canary/0.log"
May 28 19:02:44.059622 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:44.059593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48xlx_ba583c62-23b7-4271-a098-0d79ed192279/kube-rbac-proxy/0.log"
May 28 19:02:44.077951 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:44.077932    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48xlx_ba583c62-23b7-4271-a098-0d79ed192279/exporter/0.log"
May 28 19:02:44.098456 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:44.098433    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-48xlx_ba583c62-23b7-4271-a098-0d79ed192279/extractor/0.log"
May 28 19:02:46.088474 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.088445    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-fdvs5_97caf7bc-1c64-4748-9f14-29d127c7bec5/manager/0.log"
May 28 19:02:46.133197 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.133168    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69fdff467b-jngkt_72d09eaf-8d89-4c97-b357-39e55f820f6d/maas-api/0.log"
May 28 19:02:46.283267 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.283210    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64dcb8994-9sgnh_72697a89-45d4-43db-a3ea-a01a1b12fc3a/manager/0.log"
May 28 19:02:46.305334 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.305294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nbmc2_1360dfcd-d4f8-4d45-840d-6671f8ba4de7/manager/1.log"
May 28 19:02:46.326268 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.326240    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-nbmc2_1360dfcd-d4f8-4d45-840d-6671f8ba4de7/manager/2.log"
May 28 19:02:46.379696 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.379608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67686c6958-7vh6d_9ab6f240-75a3-40a3-8282-38d2208c3c33/manager/0.log"
May 28 19:02:46.711092 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:46.711024    2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fx658/perf-node-gather-daemonset-qhbj7"
May 28 19:02:53.792074 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.792048    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/kube-multus-additional-cni-plugins/0.log"
May 28 19:02:53.810979 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.810948    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/egress-router-binary-copy/0.log"
May 28 19:02:53.829659 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.829634    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/cni-plugins/0.log"
May 28 19:02:53.850242 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.850206    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/bond-cni-plugin/0.log"
May 28 19:02:53.868434 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.868410    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/routeoverride-cni/0.log"
May 28 19:02:53.889754 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.889733    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/whereabouts-cni-bincopy/0.log"
May 28 19:02:53.909845 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.909822    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzpzd_f3cde208-3b7f-4b2d-88f2-d0390cdb5c35/whereabouts-cni/0.log"
May 28 19:02:53.942364 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.942321    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bnwt6_27d8438d-b992-4b7e-9600-b5f3d0ea4b90/kube-multus/0.log"
May 28 19:02:53.987727 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:53.987695    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmn9f_2953c6b4-0ac6-4448-b422-f72618caf8b3/network-metrics-daemon/0.log"
May 28 19:02:54.004810 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:54.004778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xmn9f_2953c6b4-0ac6-4448-b422-f72618caf8b3/kube-rbac-proxy/0.log"
May 28 19:02:54.912334 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:54.912299    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/ovn-controller/0.log"
May 28 19:02:54.952107 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:54.952067    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/ovn-acl-logging/0.log"
May 28 19:02:54.974340 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:54.974311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/kube-rbac-proxy-node/0.log"
May 28 19:02:54.993947 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:54.993916    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/kube-rbac-proxy-ovn-metrics/0.log"
May 28 19:02:55.009451 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:55.009425    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/northd/0.log"
May 28 19:02:55.028275 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:55.028248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/nbdb/0.log"
May 28 19:02:55.048615 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:55.048590    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/sbdb/0.log"
May 28 19:02:55.205954 ip-10-0-133-168 kubenswrapper[2563]: I0528 19:02:55.205874    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bqb48_7f546374-21c0-4cba-a4ba-2572c1486cd3/ovnkube-controller/0.log"