May 26 16:05:52.634031 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 16:05:52.634042 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 16:05:52.634049 ip-10-0-133-107 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 16:05:52.634267 ip-10-0-133-107 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 16:06:02.883460 ip-10-0-133-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 16:06:02.883483 ip-10-0-133-107 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 0ce1fcfc783d492c966f4e9cf4e11c67 --
May 26 16:08:26.890149 ip-10-0-133-107 systemd[1]: Starting Kubernetes Kubelet...
May 26 16:08:27.284870 ip-10-0-133-107 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:08:27.284870 ip-10-0-133-107 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 16:08:27.284870 ip-10-0-133-107 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:08:27.284870 ip-10-0-133-107 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 16:08:27.284870 ip-10-0-133-107 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 16:08:27.287733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.287644    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 16:08:27.292479 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292463    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:08:27.292479 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292479    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292484    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292487    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292500    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292506    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292511    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292515    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292519    2562 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292522    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292525    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292528    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292532    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292535    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292538    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292541    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292544    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292546    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292549    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292552    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:08:27.292558 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292555    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292557    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292560    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292563    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292566    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292569    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292572    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292575    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292578    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292580    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292583    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292586    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292588    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292591    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292594    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292597    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292600    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292603    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292605    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292608    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:08:27.293074 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292610    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292613    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292616    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292618    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292628    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292630    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292633    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292635    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292638    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292641    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292644    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292650    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292652    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292655    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292659    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292662    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292664    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292667    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292670    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292672    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:08:27.293572 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292675    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292678    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292680    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292683    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292686    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292689    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292691    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292694    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292696    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292699    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292702    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292704    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292707    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292710    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292712    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292715    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292718    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292726    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292730    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292733    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:08:27.294226 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292736    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292739    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292741    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292744    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292747    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.292750    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293240    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293246    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293250    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293254    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293257    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293260    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293263    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293265    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293268    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293271    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293274    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293277    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293279    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293282    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:08:27.294735 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293285    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293287    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293290    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293292    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293295    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293298    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293300    2562 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293303    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293305    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293308    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293311    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293314    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293317    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293319    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293322    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293324    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293327    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293331    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293335    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293338    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:08:27.295259 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293340    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293343    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293346    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293348    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293351    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293353    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293356    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293359    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293362    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293364    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293367    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293369    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293372    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293374    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293377    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293380    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293382    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293385    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293388    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293391    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:08:27.295775 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293393    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293396    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293400    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293404    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293407    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293410    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293412    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293415    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293417    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293420    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293423    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293426    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293429    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293431    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293436    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293439    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293444    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293447    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293450    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:08:27.296307 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293452    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293455    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293458    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293460    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293463    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293466    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293468    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293471    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293474    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293478    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293481    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293483    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.293486    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294087    2562 flags.go:64] FLAG: --address="0.0.0.0"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294097    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294108    2562 flags.go:64] FLAG: --anonymous-auth="true"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294114    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294119    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294123    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294127    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294132    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 16:08:27.296834 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294136    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294139    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294143    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294146    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294149    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294152    2562 flags.go:64] FLAG: --cgroup-root=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294155    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294159    2562 flags.go:64] FLAG: --client-ca-file=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294161    2562 flags.go:64] FLAG: --cloud-config=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294164    2562 flags.go:64] FLAG: --cloud-provider="external"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294167    2562 flags.go:64] FLAG: --cluster-dns="[]"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294173    2562 flags.go:64] FLAG: --cluster-domain=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294176    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294179    2562 flags.go:64] FLAG: --config-dir=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294183    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294186    2562 flags.go:64] FLAG: --container-log-max-files="5"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294190    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294193    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294197    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294201    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294205    2562 flags.go:64] FLAG: --contention-profiling="false"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294208    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294212    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294215    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294218    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 16:08:27.297396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294223    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294226    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294229    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294233    2562 flags.go:64] FLAG: --enable-load-reader="false"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294237    2562 flags.go:64] FLAG: --enable-server="true"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294241    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294245    2562 flags.go:64] FLAG: --event-burst="100"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294248    2562 flags.go:64] FLAG: --event-qps="50"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294251    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294269    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294272    2562 flags.go:64] FLAG: --eviction-hard=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294276    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294280    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294283    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294286    2562 flags.go:64] FLAG: --eviction-soft=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294289    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294292    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294295    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294298    2562 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294302    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294305    2562 flags.go:64] FLAG: --fail-swap-on="true"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294308    2562 flags.go:64] FLAG: --feature-gates=""
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294312    2562 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294315    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294318    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 16:08:27.298044 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294322    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294326    2562 flags.go:64] FLAG: --healthz-port="10248"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294329    2562 flags.go:64] FLAG: --help="false"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294332    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-107.ec2.internal"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294336    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294339    2562 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294342    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294346    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294349    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294352    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294355    2562 flags.go:64] FLAG: --image-service-endpoint=""
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294360    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294363    2562 flags.go:64] FLAG: --kube-api-burst="100"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294366    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294369    2562 flags.go:64] FLAG: --kube-api-qps="50"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294372    2562 flags.go:64] FLAG: --kube-reserved=""
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294375    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294378    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294381    2562 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294384    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294387    2562 flags.go:64] FLAG: --lock-file=""
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294390    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294393    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294396    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 16:08:27.298658 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294402    2562 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294405    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294408    2562 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294411    2562 flags.go:64] FLAG: --logging-format="text"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294414    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294417    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294420    2562 flags.go:64] FLAG: --manifest-url=""
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294423    2562 flags.go:64] FLAG: --manifest-url-header=""
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294428    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294431    2562 flags.go:64] FLAG: --max-open-files="1000000"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294440    2562 flags.go:64] FLAG: --max-pods="110"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294443    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294446    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294450    2562 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294453    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294456    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294459    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294462    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294470    2562 flags.go:64] FLAG: --node-status-max-images="50"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294473    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294477    2562 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294480    2562 flags.go:64] FLAG: --pod-cidr=""
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294483    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 16:08:27.299274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294489    2562 flags.go:64] FLAG: --pod-manifest-path=""
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294492    2562 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294495    2562 flags.go:64] FLAG: --pods-per-core="0"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294498    2562 flags.go:64] FLAG: --port="10250"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294501    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294504    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-066575019d0d256b0"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294508    2562 flags.go:64] FLAG: --qos-reserved=""
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294511    2562 flags.go:64] FLAG: --read-only-port="10255"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294514    2562 flags.go:64] FLAG: --register-node="true"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294517    2562 flags.go:64] FLAG: --register-schedulable="true"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294520    2562 flags.go:64] FLAG: --register-with-taints=""
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294526    2562 flags.go:64] FLAG: --registry-burst="10"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294529    2562 flags.go:64] FLAG: --registry-qps="5"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294532    2562 flags.go:64] FLAG: --reserved-cpus=""
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294535    2562 flags.go:64] FLAG: --reserved-memory=""
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294539    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294542    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294545    2562 flags.go:64] FLAG: --rotate-certificates="false"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294548    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294551    2562 flags.go:64] FLAG: --runonce="false"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294556    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294559    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294562    2562 flags.go:64] FLAG: --seccomp-default="false"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294565    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294569    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294572    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 16:08:27.299839 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294576    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294579    2562 flags.go:64] FLAG: --storage-driver-password="root"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294583    2562 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294586    2562 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294589    2562 flags.go:64] FLAG: --storage-driver-user="root"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294592    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294595    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294598    2562 flags.go:64] FLAG: --system-cgroups=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294601    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294607    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294610    2562 flags.go:64] FLAG: --tls-cert-file=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294613    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294621    2562 flags.go:64] FLAG: --tls-min-version=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294624    2562 flags.go:64] FLAG: --tls-private-key-file=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294627    2562 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294630    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294633    2562 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294643    2562 flags.go:64] FLAG: --v="2"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294647    2562 flags.go:64] FLAG: --version="false"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294651    2562 flags.go:64] FLAG: --vmodule=""
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294656    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.294660    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294776    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294779    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:08:27.300493 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294783    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294785    2562 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294789    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294792    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294795    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294798    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294801    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294803    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294806    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294809    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294812    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294815    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294818    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294821    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294824    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294826    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294829    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294832    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294835    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294837    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294840    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:08:27.301381 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294843    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294846    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294848    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294851    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294855    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294857    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294874    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294877    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294880    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294883    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294886    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294889    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294895    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294898    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294901    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294904    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294907    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294910    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:08:27.302359 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294914    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294917    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294920    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294923    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294925    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294928    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294937    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294940    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294943    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294945    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294948    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294950    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294953    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294956    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294959    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294961    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294964    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294968    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294971    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:08:27.303124 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294974    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294976    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294979    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294982    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294984    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294987    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294990    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294993    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.294998    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295001    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295004    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295008    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295011    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295014    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295016    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295019    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295021    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295024    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295027    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295029    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:08:27.304366 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295033    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295035    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295038    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295041    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.295043    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.295561    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.304518    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.304536    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304585    2562 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304591    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304594    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304597    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304602    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304607    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304611    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:08:27.304899 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304616    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304620    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304623    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304626    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304629    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304632    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304635    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304638    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304641    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304644    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304647    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304649    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304652    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304656    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304658    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304661    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304664    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304667    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304670    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304673    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:08:27.305315 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304676    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304679    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304682    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304685    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304688    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304691    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304693    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304696    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304698    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304701    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304703    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304706    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304709    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304712    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304714    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304717    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304719    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304722    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304725    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304728    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:08:27.305830 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304730    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304733    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304736    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304738    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304741    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304744    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304746    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304749    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304752    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304754    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304757    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304760    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304763    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304766    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304769    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304771    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304774    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304777    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304780    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304783    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:08:27.306356 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304785    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304788    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304790    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304794    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304796    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304799    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304802    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304804    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304807    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304811    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304814    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304816    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304819    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304821    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304824    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304827    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304842    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304845    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:08:27.306886 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304847    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.304853    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304966    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304972    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304975    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304979    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304982    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304985    2562 feature_gate.go:328] unrecognized feature gate: Example
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304988    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304991    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304994    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304997    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.304999    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305003    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305006    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 16:08:27.307343 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305010    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305014    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305018    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305022    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305025    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305028    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305031    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305033    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305036    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305040    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305042    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305045    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305048    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305050    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305053    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305056    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305059    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305061    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305064    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 16:08:27.307733 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305067    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305069    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305073    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305075    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305078    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305081    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305083    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305086    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305089    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305091    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305103    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305106    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305109    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305112    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305114    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305117    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305120    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305123    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305126    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305128    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 16:08:27.308301 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305131    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305134    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305136    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305140    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305142    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305145    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305148    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305150    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305153    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305156    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305158    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305161    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305163    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305166    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305169    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305172    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305174    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305177    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305180    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 16:08:27.308855 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305183    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305186    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305188    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305191    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305194    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305197    2562 feature_gate.go:328] unrecognized feature gate: Example2
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305199    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305202    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305205    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305207    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305210    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305212    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305215    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305218    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:27.305220    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.305225    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 16:08:27.309385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.305911    2562 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 16:08:27.309794 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.308323    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 16:08:27.309794 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.309138    2562 server.go:1019] "Starting client certificate rotation"
May 26 16:08:27.309794 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.309235    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:08:27.309794 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.309274    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 16:08:27.331897 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.331877    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:08:27.333088 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.333068    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 16:08:27.348118 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.348099    2562 log.go:25] "Validated CRI v1 runtime API"
May 26 16:08:27.353003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.352988    2562 log.go:25] "Validated CRI v1 image API"
May 26 16:08:27.354854 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.354841    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 16:08:27.357832 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.357781    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 eff63ce7-43aa-40b5-bec9-16d623b83f6f:/dev/nvme0n1p4 fb343d56-10fa-4fa9-94ea-4e1b78587660:/dev/nvme0n1p3]
May 26 16:08:27.357917 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.357832    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 16:08:27.359302 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.359283    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:08:27.363258 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.363150    2562 manager.go:217] Machine: {Timestamp:2026-05-26 16:08:27.362639189 +0000 UTC m=+0.366862735 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099858 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22290f16155a74b08fc8df7d2fcbed SystemUUID:ec22290f-1615-5a74-b08f-c8df7d2fcbed BootID:0ce1fcfc-783d-492c-966f-4e9cf4e11c67 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:48:d5:67:1f:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:48:d5:67:1f:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:25:92:00:a0:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 16:08:27.363870 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.363858    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 16:08:27.363946 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.363934    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 16:08:27.365515 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.365493    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 16:08:27.365639 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.365517    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 16:08:27.365686 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.365650    2562 topology_manager.go:138] "Creating topology manager with none policy"
May 26 16:08:27.365686 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.365659    2562 container_manager_linux.go:306] "Creating device plugin manager"
May 26 16:08:27.365686 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.365666    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:08:27.366326 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.366315    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 16:08:27.368151 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.368141    2562 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:08:27.368257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.368248    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 16:08:27.370217 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.370207    2562 kubelet.go:491] "Attempting to sync node with API server"
May 26 16:08:27.370257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.370223    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 16:08:27.370257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.370236    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 16:08:27.370257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.370245    2562 kubelet.go:397] "Adding apiserver pod source"
May 26 16:08:27.370257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.370254    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 16:08:27.371254 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.371238    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:08:27.371312 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.371266    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 16:08:27.373858 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.373843    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 16:08:27.375603 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.375589    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 16:08:27.376384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376372    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376389    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376396    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376402    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376414    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376422    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 16:08:27.376430 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376428    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 16:08:27.376588 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376434    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 16:08:27.376588 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376442    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 16:08:27.376588 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376447    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 16:08:27.376588 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376457    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 16:08:27.376691 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.376682    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 16:08:27.377560 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.377549    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 16:08:27.377603 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.377564    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 16:08:27.380652 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.380638    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 16:08:27.380718 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.380674    2562 server.go:1295] "Started kubelet"
May 26 16:08:27.380764 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.380723    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 16:08:27.380803 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.380758    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 16:08:27.380860 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.380830    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 16:08:27.381559 ip-10-0-133-107 systemd[1]: Started Kubernetes Kubelet.
May 26 16:08:27.382180 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.382079    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 16:08:27.383435 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.383416    2562 server.go:317] "Adding debug handlers to kubelet server"
May 26 16:08:27.384296 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.384236    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 16:08:27.384296 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.384240    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 16:08:27.384620 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.384605    2562 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 16:08:27.386917 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.386131    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18b3295169815496  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-05-26 16:08:27.380651158 +0000 UTC m=+0.384874705,LastTimestamp:2026-05-26 16:08:27.380651158 +0000 UTC m=+0.384874705,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
May 26 16:08:27.389750 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.389732    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 16:08:27.390276 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390258    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 16:08:27.390360 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390342    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 16:08:27.390360 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390359    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 16:08:27.390467 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390458    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 16:08:27.390515 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.390503    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 16:08:27.390568 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390560    2562 reconstruct.go:97] "Volume reconstruction finished"
May 26 16:08:27.390613 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.390571    2562 reconciler.go:26] "Reconciler: start to sync state"
May 26 16:08:27.391135 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.391058    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.391390 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.391375    2562 factory.go:55] Registering systemd factory
May 26 16:08:27.391477 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.391467    2562 factory.go:223] Registration of the systemd container factory successfully
May 26 16:08:27.392585 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.392573    2562 factory.go:153] Registering CRI-O factory
May 26 16:08:27.392673 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.392665    2562 factory.go:223] Registration of the crio container factory successfully
May 26 16:08:27.392779 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.392770    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 16:08:27.392881 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.392870    2562 factory.go:103] Registering Raw factory
May 26 16:08:27.392960 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.392954    2562 manager.go:1196] Started watching for new ooms in manager
May 26 16:08:27.393495 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.393473    2562 manager.go:319] Starting recovery of all containers
May 26 16:08:27.396284 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.396255    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 16:08:27.397123 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.397097    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 16:08:27.403904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.403744    2562 manager.go:324] Recovery completed
May 26 16:08:27.407829 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.407796    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bt98w"
May 26 16:08:27.408061 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.408050    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.409874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.409860    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.409962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.409891    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.409962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.409905    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.410378 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.410366    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 16:08:27.410424 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.410380    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 16:08:27.410424 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.410397    2562 state_mem.go:36] "Initialized new in-memory state store"
May 26 16:08:27.412096 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.412030    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-107.ec2.internal.18b329516b3f3f09  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-107.ec2.internal,UID:ip-10-0-133-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-107.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-107.ec2.internal,},FirstTimestamp:2026-05-26 16:08:27.409874697 +0000 UTC m=+0.414098246,LastTimestamp:2026-05-26 16:08:27.409874697 +0000 UTC m=+0.414098246,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-107.ec2.internal,}"
May 26 16:08:27.412888 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.412876    2562 policy_none.go:49] "None policy: Start"
May 26 16:08:27.412939 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.412893    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 16:08:27.412939 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.412905    2562 state_mem.go:35] "Initializing new in-memory state store"
May 26 16:08:27.415541 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.415525    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bt98w"
May 26 16:08:27.446357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.446343    2562 manager.go:341] "Starting Device Plugin manager"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.446370    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.446380    2562 server.go:85] "Starting device plugin registration server"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.446566    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.446577    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.447155    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.447237    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.447246    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.447443    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 16:08:27.500485 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.447479    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.521141 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.521113    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 16:08:27.522316 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.522299    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 16:08:27.522382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.522326    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 16:08:27.522382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.522350    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 16:08:27.522382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.522359    2562 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 16:08:27.522508 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.522404    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 16:08:27.525880 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.525859    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:27.547421 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.547380    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.548481 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.548463    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.548555 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.548490    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.548555 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.548500    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.548555 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.548521    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-107.ec2.internal"
May 26 16:08:27.556657 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.556638    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-107.ec2.internal"
May 26 16:08:27.556733 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.556660    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-107.ec2.internal\": node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.576622 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.576598    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.622763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.622697    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"]
May 26 16:08:27.622895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.622829    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.623869 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.623855    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.623950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.623883    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.623950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.623893    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.625289 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.625277    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.625468 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.625451    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.625542 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.625530    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.626035 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626012    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.626123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626039    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.626123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626049    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.626123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626012    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.626123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626112    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.626123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.626123    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.627274 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.627260    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.627348 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.627282    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 16:08:27.628095 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.628081    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientMemory"
May 26 16:08:27.628155 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.628111    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasNoDiskPressure"
May 26 16:08:27.628155 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.628125    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeHasSufficientPID"
May 26 16:08:27.665605 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.665579    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-107.ec2.internal\" not found" node="ip-10-0-133-107.ec2.internal"
May 26 16:08:27.669811 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.669795    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-107.ec2.internal\" not found" node="ip-10-0-133-107.ec2.internal"
May 26 16:08:27.677424 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.677407    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.692475 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.692456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.692538 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.692480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a5e6230d598a6959a877daf9ec83d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"3a5e6230d598a6959a877daf9ec83d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.692538 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.692497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.778324 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.778291    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.793654 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793621    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a5e6230d598a6959a877daf9ec83d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"3a5e6230d598a6959a877daf9ec83d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.793654 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793657    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.793772 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793686    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.793772 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793726    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.793772 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4d2ca73a2516d012ff28b4918ffe4448-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal\" (UID: \"4d2ca73a2516d012ff28b4918ffe4448\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.793772 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.793735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3a5e6230d598a6959a877daf9ec83d5e-config\") pod \"kube-apiserver-proxy-ip-10-0-133-107.ec2.internal\" (UID: \"3a5e6230d598a6959a877daf9ec83d5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.879090 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.879025    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:27.968475 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.968454    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.973166 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:27.973149    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:27.980092 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:27.980073    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.080745 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.080717    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.181233 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.181173    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.281631 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.281605    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.286907 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.286889    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:28.308880 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.308857    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 16:08:28.309000 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.308983    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:08:28.309053 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.309010    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 16:08:28.382461 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.382432    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.390438 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.390403    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 16:08:28.409297 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.409277    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 16:08:28.417403 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.417377    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 16:03:27 +0000 UTC" deadline="2027-12-14 12:43:04.369997504 +0000 UTC"
May 26 16:08:28.417403 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.417400    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13604h34m35.952599683s"
May 26 16:08:28.456283 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:28.456103    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5e6230d598a6959a877daf9ec83d5e.slice/crio-aa36e6c85a34548bec623c42d5a67a84314ff4fe383659d366805ac4c7d90004 WatchSource:0}: Error finding container aa36e6c85a34548bec623c42d5a67a84314ff4fe383659d366805ac4c7d90004: Status 404 returned error can't find the container with id aa36e6c85a34548bec623c42d5a67a84314ff4fe383659d366805ac4c7d90004
May 26 16:08:28.456794 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:28.456770    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2ca73a2516d012ff28b4918ffe4448.slice/crio-8e256eda01cbe5c462a3aaa417dc556c245e4df4904023eb60c2f07586d873a6 WatchSource:0}: Error finding container 8e256eda01cbe5c462a3aaa417dc556c245e4df4904023eb60c2f07586d873a6: Status 404 returned error can't find the container with id 8e256eda01cbe5c462a3aaa417dc556c245e4df4904023eb60c2f07586d873a6
May 26 16:08:28.459221 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.459206    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:08:28.483510 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.483488    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.525537 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.525490    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" event={"ID":"3a5e6230d598a6959a877daf9ec83d5e","Type":"ContainerStarted","Data":"aa36e6c85a34548bec623c42d5a67a84314ff4fe383659d366805ac4c7d90004"}
May 26 16:08:28.526294 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.526270    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4d2ca73a2516d012ff28b4918ffe4448","Type":"ContainerStarted","Data":"8e256eda01cbe5c462a3aaa417dc556c245e4df4904023eb60c2f07586d873a6"}
May 26 16:08:28.532962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.532947    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdr97"
May 26 16:08:28.540565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.540547    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qdr97"
May 26 16:08:28.583823 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.583798    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.684334 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.684303    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.784858 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.784780    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.840973 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.840951    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:28.885332 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:28.885294    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-107.ec2.internal\" not found"
May 26 16:08:28.894428 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.894270    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:28.991418 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:28.991386    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal"
May 26 16:08:29.005356 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.005332    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:08:29.006161 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.006137    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal"
May 26 16:08:29.015190 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.015170    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 16:08:29.371894 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.371864    2562 apiserver.go:52] "Watching apiserver"
May 26 16:08:29.378591 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.378569    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 16:08:29.378998 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.378966    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l","openshift-dns/node-resolver-p4mmb","openshift-image-registry/node-ca-m8p7m","openshift-multus/network-metrics-daemon-v7p2l","openshift-network-diagnostics/network-check-target-9d9d9","openshift-network-operator/iptables-alerter-h9nsz","kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2d7br","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-hpr5z","openshift-multus/multus-t6bmg","openshift-ovn-kubernetes/ovnkube-node-hbstd","kube-system/konnectivity-agent-mwpg4"]
May 26 16:08:29.381715 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.381688    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.384472 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.383257    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.384472 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.383361    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.384873    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.385008    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmcfd\""
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.385166    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.385249    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.385398    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 16:08:29.385641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.385498    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 16:08:29.386837 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.386414    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 16:08:29.386837 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.386626    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 16:08:29.386837 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.386689    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wcjqj\""
May 26 16:08:29.387040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.386840    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6xskk\""
May 26 16:08:29.387040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.386906    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 16:08:29.387040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.387004    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 16:08:29.387040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.387017    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 16:08:29.387877 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.387854    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.387973 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.387918    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:29.387973 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.387936    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:29.388069 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.387977    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:29.390451 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.390432    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.391618 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.391563    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.392974 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.392900    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 16:08:29.392974 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.392939    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2fnhx\""
May 26 16:08:29.393208 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.393180    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 16:08:29.393412 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.393399    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 16:08:29.393726 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.393708    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 16:08:29.393961 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.393940    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 16:08:29.394080 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.394024    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p45s7\""
May 26 16:08:29.394196 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.394180    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.394288 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.394270    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.395666 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.395647    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.396554 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.396537    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 16:08:29.396959 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.396932    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 16:08:29.397050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.396959    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 16:08:29.397050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.397026    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 16:08:29.397182 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.397109    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rqqcs\""
May 26 16:08:29.397182 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.397151    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.397182 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.397170    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-crj2s\""
May 26 16:08:29.398104 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398048    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 16:08:29.398379 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398275    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jqcs6\""
May 26 16:08:29.398379 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398300    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 16:08:29.398513 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398474    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 16:08:29.398586 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398544    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 16:08:29.398653 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398643    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 16:08:29.398846 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.398799    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 16:08:29.399323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.399306    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 16:08:29.399553 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.399535    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pdgnc\""
May 26 16:08:29.399631 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.399566    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 16:08:29.401979 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.401946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slx7\" (UniqueName: \"kubernetes.io/projected/7b92edc4-3414-47c2-8de0-c137f9ebcc59-kube-api-access-8slx7\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402068 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.401984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58998204-28a6-4576-950a-eece0c4e0065-serviceca\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.402068 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402068 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-sys\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.402226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ktd\" (UniqueName: \"kubernetes.io/projected/701d28a7-dc07-49e0-9e8a-60a836437170-kube-api-access-l6ktd\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.402226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-var-lib-kubelet\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-system-cni-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysconfig\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-host\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78db7de9-47fb-48e4-908e-5c3b01131daa-tmp-dir\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-modprobe-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-conf\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402578    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbrrz\" (UniqueName: \"kubernetes.io/projected/58998204-28a6-4576-950a-eece0c4e0065-kube-api-access-nbrrz\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.402627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlph\" (UniqueName: \"kubernetes.io/projected/3e24b597-ac2a-480d-92c2-cfeeba439dcb-kube-api-access-2hlph\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-kubernetes\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-systemd\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-tmp\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-socket-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-device-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-sys-fs\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cnibin\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-os-release\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.402908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78db7de9-47fb-48e4-908e-5c3b01131daa-hosts-file\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-lib-modules\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.402965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e24b597-ac2a-480d-92c2-cfeeba439dcb-iptables-alerter-script\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e24b597-ac2a-480d-92c2-cfeeba439dcb-host-slash\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-tuned\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-registration-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58998204-28a6-4576-950a-eece0c4e0065-host\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w45wv\" (UniqueName: \"kubernetes.io/projected/10b60085-8508-4a05-af14-764fad91d29a-kube-api-access-w45wv\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-run\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjch\" (UniqueName: \"kubernetes.io/projected/78db7de9-47fb-48e4-908e-5c3b01131daa-kube-api-access-fsjch\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbz7n\" (UniqueName: \"kubernetes.io/projected/8c276286-09d2-4549-a4f4-7b878bce45b7-kube-api-access-nbz7n\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.403304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.403224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-etc-selinux\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.483746 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.483714    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:29.492134 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.492109    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 16:08:29.503786 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503751    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-tuned\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.503915 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503811    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-registration-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.503915 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503875    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58998204-28a6-4576-950a-eece0c4e0065-host\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.503915 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503897    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-registration-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.504069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-os-release\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.504069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-multus-certs\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.504069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503991    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/58998204-28a6-4576-950a-eece0c4e0065-host\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.504069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.503991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-etc-kubernetes\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.504069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-var-lib-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-netd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504127    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504148    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-run\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504186    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjch\" (UniqueName: \"kubernetes.io/projected/78db7de9-47fb-48e4-908e-5c3b01131daa-kube-api-access-fsjch\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504211    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbz7n\" (UniqueName: \"kubernetes.io/projected/8c276286-09d2-4549-a4f4-7b878bce45b7-kube-api-access-nbz7n\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-etc-selinux\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504288    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8slx7\" (UniqueName: \"kubernetes.io/projected/7b92edc4-3414-47c2-8de0-c137f9ebcc59-kube-api-access-8slx7\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.504309 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-run\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-systemd-units\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-script-lib\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ctr\" (UniqueName: \"kubernetes.io/projected/34bae38d-5d65-4bbe-88d3-aded265be8b0-kube-api-access-q5ctr\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504411    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-etc-selinux\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504458    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504481    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-sys\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504507    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-sys\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504599    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ktd\" (UniqueName: \"kubernetes.io/projected/701d28a7-dc07-49e0-9e8a-60a836437170-kube-api-access-l6ktd\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-bin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.504676 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504667    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-kubelet\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-hostroot\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.504957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-systemd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505001    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-var-lib-kubelet\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-cnibin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505090    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-var-lib-kubelet\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-etc-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-config\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.505187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505190    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-konnectivity-ca\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505219    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysconfig\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505247    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505273    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505280    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysconfig\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505296    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505332    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78db7de9-47fb-48e4-908e-5c3b01131daa-tmp-dir\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505356    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-modprobe-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.505376    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505380    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-conf\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505405    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505431    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.505448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:30.005417514 +0000 UTC m=+3.009641067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505465    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbrrz\" (UniqueName: \"kubernetes.io/projected/58998204-28a6-4576-950a-eece0c4e0065-kube-api-access-nbrrz\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505496    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505511    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-modprobe-d\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-ovn\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.505636 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505548    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-kubernetes\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505587    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-systemd\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505617    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-tmp\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505654    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-socket-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505682    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-sys-fs\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505705    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cnibin\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505729    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-os-release\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/78db7de9-47fb-48e4-908e-5c3b01131daa-tmp-dir\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-socket-dir-parent\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505785    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78db7de9-47fb-48e4-908e-5c3b01131daa-hosts-file\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-lib-modules\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505835    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-kubernetes\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505850    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e24b597-ac2a-480d-92c2-cfeeba439dcb-host-slash\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mph\" (UniqueName: \"kubernetes.io/projected/94487320-4f78-45a5-8c53-c638c62c73e6-kube-api-access-g5mph\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-netns\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-cni-binary-copy\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.506394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.505951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-conf-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-systemd\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-log-socket\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-env-overrides\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506114    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w45wv\" (UniqueName: \"kubernetes.io/projected/10b60085-8508-4a05-af14-764fad91d29a-kube-api-access-w45wv\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506141    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58998204-28a6-4576-950a-eece0c4e0065-serviceca\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506200    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-kubelet\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506267    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-system-cni-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-netns\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-multus-daemon-config\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506345    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-host\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-system-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-agent-certs\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506515    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-sysctl-conf\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.507149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-socket-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-multus\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-lib-modules\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506744    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlph\" (UniqueName: \"kubernetes.io/projected/3e24b597-ac2a-480d-92c2-cfeeba439dcb-kube-api-access-2hlph\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506772    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-device-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/78db7de9-47fb-48e4-908e-5c3b01131daa-hosts-file\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-sys-fs\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/58998204-28a6-4576-950a-eece0c4e0065-serviceca\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506962    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-system-cni-dir\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.506971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3e24b597-ac2a-480d-92c2-cfeeba439dcb-host-slash\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507007    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c276286-09d2-4549-a4f4-7b878bce45b7-host\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-cnibin\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507039    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/10b60085-8508-4a05-af14-764fad91d29a-device-dir\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b92edc4-3414-47c2-8de0-c137f9ebcc59-os-release\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507073    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e24b597-ac2a-480d-92c2-cfeeba439dcb-iptables-alerter-script\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-k8s-cni-cncf-io\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.507727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-slash\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-node-log\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7b92edc4-3414-47c2-8de0-c137f9ebcc59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-bin\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507556    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovn-node-metrics-cert\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3e24b597-ac2a-480d-92c2-cfeeba439dcb-iptables-alerter-script\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.508385 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.507675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-etc-tuned\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.508655 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.508499    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c276286-09d2-4549-a4f4-7b878bce45b7-tmp\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.513454 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.513423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slx7\" (UniqueName: \"kubernetes.io/projected/7b92edc4-3414-47c2-8de0-c137f9ebcc59-kube-api-access-8slx7\") pod \"multus-additional-cni-plugins-hpr5z\" (UID: \"7b92edc4-3414-47c2-8de0-c137f9ebcc59\") " pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.513672 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.513564    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbz7n\" (UniqueName: \"kubernetes.io/projected/8c276286-09d2-4549-a4f4-7b878bce45b7-kube-api-access-nbz7n\") pod \"tuned-2d7br\" (UID: \"8c276286-09d2-4549-a4f4-7b878bce45b7\") " pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.513797 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.513778    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ktd\" (UniqueName: \"kubernetes.io/projected/701d28a7-dc07-49e0-9e8a-60a836437170-kube-api-access-l6ktd\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:29.513856 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.513840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjch\" (UniqueName: \"kubernetes.io/projected/78db7de9-47fb-48e4-908e-5c3b01131daa-kube-api-access-fsjch\") pod \"node-resolver-p4mmb\" (UID: \"78db7de9-47fb-48e4-908e-5c3b01131daa\") " pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.516685 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.516664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbrrz\" (UniqueName: \"kubernetes.io/projected/58998204-28a6-4576-950a-eece0c4e0065-kube-api-access-nbrrz\") pod \"node-ca-m8p7m\" (UID: \"58998204-28a6-4576-950a-eece0c4e0065\") " pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.518216 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.518197    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:29.518216 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.518222    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:29.518345 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.518235    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:29.518390 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:29.518376    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:08:30.018358848 +0000 UTC m=+3.022582406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:29.520306 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.520282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w45wv\" (UniqueName: \"kubernetes.io/projected/10b60085-8508-4a05-af14-764fad91d29a-kube-api-access-w45wv\") pod \"aws-ebs-csi-driver-node-4z97l\" (UID: \"10b60085-8508-4a05-af14-764fad91d29a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.520387 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.520362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlph\" (UniqueName: \"kubernetes.io/projected/3e24b597-ac2a-480d-92c2-cfeeba439dcb-kube-api-access-2hlph\") pod \"iptables-alerter-h9nsz\" (UID: \"3e24b597-ac2a-480d-92c2-cfeeba439dcb\") " pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.541849 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.541804    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 16:03:28 +0000 UTC" deadline="2028-01-07 17:36:03.90374432 +0000 UTC"
May 26 16:08:29.541849 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.541846    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14185h27m34.361901045s"
May 26 16:08:29.607982 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.607956    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-system-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.607982 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.607986    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-agent-certs\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608007    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-multus\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608033    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-k8s-cni-cncf-io\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608058    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-slash\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-system-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608083    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-node-log\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-multus\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608113    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-bin\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-node-log\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608140    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-bin\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-slash\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608189    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-k8s-cni-cncf-io\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608199    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovn-node-metrics-cert\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608268    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-os-release\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608297    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-multus-certs\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-os-release\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608321    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-etc-kubernetes\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608359    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-var-lib-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608366    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-multus-certs\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608372    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-etc-kubernetes\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608385    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-netd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608409    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-var-lib-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608450    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-systemd-units\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608475    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-script-lib\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-cni-netd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608500    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ctr\" (UniqueName: \"kubernetes.io/projected/34bae38d-5d65-4bbe-88d3-aded265be8b0-kube-api-access-q5ctr\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.608660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608511    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-systemd-units\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608529    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-bin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-cni-bin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608602    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-kubelet\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608625    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-hostroot\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608648    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-systemd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608672    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-cnibin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608695    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-etc-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608719    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-config\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608771    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-konnectivity-ca\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608840    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-cnibin\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608843    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-ovn\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-ovn\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608892    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-socket-dir-parent\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-etc-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608927    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mph\" (UniqueName: \"kubernetes.io/projected/94487320-4f78-45a5-8c53-c638c62c73e6-kube-api-access-g5mph\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-openvswitch\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.609565 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608958    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-netns\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608993    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-cni-binary-copy\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.608997    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-netns\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609019    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-conf-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-var-lib-kubelet\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609044    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-log-socket\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609074    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-log-socket\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609074    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-script-lib\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-run-ovn-kubernetes\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609104    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-env-overrides\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609138    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609142    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-hostroot\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609164    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-kubelet\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-socket-dir-parent\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609192    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-netns\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609225    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-multus-daemon-config\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609227    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-host-run-netns\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.610386 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-run-systemd\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609719    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovnkube-config\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-multus-daemon-config\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609884    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-konnectivity-ca\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609911    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-cni-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94487320-4f78-45a5-8c53-c638c62c73e6-multus-conf-dir\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.609957    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/34bae38d-5d65-4bbe-88d3-aded265be8b0-host-kubelet\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.610134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/34bae38d-5d65-4bbe-88d3-aded265be8b0-env-overrides\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.610370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94487320-4f78-45a5-8c53-c638c62c73e6-cni-binary-copy\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.610741    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/34bae38d-5d65-4bbe-88d3-aded265be8b0-ovn-node-metrics-cert\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.611375 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.610869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c-agent-certs\") pod \"konnectivity-agent-mwpg4\" (UID: \"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c\") " pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:29.617634 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.617606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mph\" (UniqueName: \"kubernetes.io/projected/94487320-4f78-45a5-8c53-c638c62c73e6-kube-api-access-g5mph\") pod \"multus-t6bmg\" (UID: \"94487320-4f78-45a5-8c53-c638c62c73e6\") " pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.618079 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.618065    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ctr\" (UniqueName: \"kubernetes.io/projected/34bae38d-5d65-4bbe-88d3-aded265be8b0-kube-api-access-q5ctr\") pod \"ovnkube-node-hbstd\" (UID: \"34bae38d-5d65-4bbe-88d3-aded265be8b0\") " pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.694717 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.694650    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpr5z"
May 26 16:08:29.702160 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.702132    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4mmb"
May 26 16:08:29.710323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.710305    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m8p7m"
May 26 16:08:29.716874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.716855    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9nsz"
May 26 16:08:29.723491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.723474    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2d7br"
May 26 16:08:29.730042 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.730025    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l"
May 26 16:08:29.735603 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.735583    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6bmg"
May 26 16:08:29.743179 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.743157    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:29.748701 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:29.748680    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:30.012673 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.012608    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:30.012802 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.012723    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:30.012802 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.012773    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:31.012758399 +0000 UTC m=+4.016981945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:30.028238 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.028212    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78db7de9_47fb_48e4_908e_5c3b01131daa.slice/crio-adaefb4acfefaa59f0d18b7f77e9555e6faad632ef483c63ee6f97d62fb39f36 WatchSource:0}: Error finding container adaefb4acfefaa59f0d18b7f77e9555e6faad632ef483c63ee6f97d62fb39f36: Status 404 returned error can't find the container with id adaefb4acfefaa59f0d18b7f77e9555e6faad632ef483c63ee6f97d62fb39f36
May 26 16:08:30.029112 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.029092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58998204_28a6_4576_950a_eece0c4e0065.slice/crio-a26ced6af76e82bf5e71647f23a7c825b1b3dbad3b03e97a0c58018ca90d6ffe WatchSource:0}: Error finding container a26ced6af76e82bf5e71647f23a7c825b1b3dbad3b03e97a0c58018ca90d6ffe: Status 404 returned error can't find the container with id a26ced6af76e82bf5e71647f23a7c825b1b3dbad3b03e97a0c58018ca90d6ffe
May 26 16:08:30.029902 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.029880    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34bae38d_5d65_4bbe_88d3_aded265be8b0.slice/crio-503bb7e271624a6fe3b5af4e667731b4314cdf0dc44ee011fdebfa688e2375b5 WatchSource:0}: Error finding container 503bb7e271624a6fe3b5af4e667731b4314cdf0dc44ee011fdebfa688e2375b5: Status 404 returned error can't find the container with id 503bb7e271624a6fe3b5af4e667731b4314cdf0dc44ee011fdebfa688e2375b5
May 26 16:08:30.033601 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.033580    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94487320_4f78_45a5_8c53_c638c62c73e6.slice/crio-4a6c43bbd9786d20efee5834a464a4de1dfaee94a26d612befbaee17126863cb WatchSource:0}: Error finding container 4a6c43bbd9786d20efee5834a464a4de1dfaee94a26d612befbaee17126863cb: Status 404 returned error can't find the container with id 4a6c43bbd9786d20efee5834a464a4de1dfaee94a26d612befbaee17126863cb
May 26 16:08:30.034520 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.034497    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c276286_09d2_4549_a4f4_7b878bce45b7.slice/crio-06d9f5d482a0bdab20f6aee18b7e7485ac2d7c65913c47900a8afa21b4d4550c WatchSource:0}: Error finding container 06d9f5d482a0bdab20f6aee18b7e7485ac2d7c65913c47900a8afa21b4d4550c: Status 404 returned error can't find the container with id 06d9f5d482a0bdab20f6aee18b7e7485ac2d7c65913c47900a8afa21b4d4550c
May 26 16:08:30.035496 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.035472    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e24b597_ac2a_480d_92c2_cfeeba439dcb.slice/crio-8600ae41e16656a2f365bfad3971c7104f915d6dbb36e672a2026e58c76ef0d9 WatchSource:0}: Error finding container 8600ae41e16656a2f365bfad3971c7104f915d6dbb36e672a2026e58c76ef0d9: Status 404 returned error can't find the container with id 8600ae41e16656a2f365bfad3971c7104f915d6dbb36e672a2026e58c76ef0d9
May 26 16:08:30.036620 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.036599    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b92edc4_3414_47c2_8de0_c137f9ebcc59.slice/crio-70a12ef22c4e6c7b2782669e16185e9464fb07ad7fd1776bc3f733e559bb2ea0 WatchSource:0}: Error finding container 70a12ef22c4e6c7b2782669e16185e9464fb07ad7fd1776bc3f733e559bb2ea0: Status 404 returned error can't find the container with id 70a12ef22c4e6c7b2782669e16185e9464fb07ad7fd1776bc3f733e559bb2ea0
May 26 16:08:30.038392 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.038366    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b60085_8508_4a05_af14_764fad91d29a.slice/crio-30f49427968a8e1e701a4d21d8e7fd2b5a1fc4ae97cc631875e4c2058ae2f7bb WatchSource:0}: Error finding container 30f49427968a8e1e701a4d21d8e7fd2b5a1fc4ae97cc631875e4c2058ae2f7bb: Status 404 returned error can't find the container with id 30f49427968a8e1e701a4d21d8e7fd2b5a1fc4ae97cc631875e4c2058ae2f7bb
May 26 16:08:30.040038 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:08:30.039723    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5b1ae93_a5f3_4e46_95f3_5579e3b6a22c.slice/crio-7379d61ff0921d11a9098b87f82e8c2ef6c56ca5b94d5fcd333dc46507ad9841 WatchSource:0}: Error finding container 7379d61ff0921d11a9098b87f82e8c2ef6c56ca5b94d5fcd333dc46507ad9841: Status 404 returned error can't find the container with id 7379d61ff0921d11a9098b87f82e8c2ef6c56ca5b94d5fcd333dc46507ad9841
May 26 16:08:30.097483 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.097347    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 16:08:30.113379 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.113325    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:30.113527 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.113484    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:30.113527 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.113505    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:30.113527 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.113517    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:30.113700 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.113590    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:08:31.113554348 +0000 UTC m=+4.117777898 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:30.176311 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.176284    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tvfqz"]
May 26 16:08:30.177884 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.177867    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.177974 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.177933    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:30.214350 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.214317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.214465 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.214359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-kubelet-config\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.214465 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.214404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-dbus\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.314721 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.314698    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.314855 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.314732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-kubelet-config\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.314916 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.314846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-kubelet-config\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.314916 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.314895    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:30.315017 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.314910    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-dbus\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.315017 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.314939    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:30.814925749 +0000 UTC m=+3.819149287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:30.315113 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.315019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-dbus\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.523531 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.522998    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:30.523531 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.523136    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:30.540786 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.540715    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4mmb" event={"ID":"78db7de9-47fb-48e4-908e-5c3b01131daa","Type":"ContainerStarted","Data":"adaefb4acfefaa59f0d18b7f77e9555e6faad632ef483c63ee6f97d62fb39f36"}
May 26 16:08:30.542153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.542089    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 16:03:28 +0000 UTC" deadline="2028-03-07 11:51:32.53449178 +0000 UTC"
May 26 16:08:30.542153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.542121    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15619h43m1.992375172s"
May 26 16:08:30.544938 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.544893    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l" event={"ID":"10b60085-8508-4a05-af14-764fad91d29a","Type":"ContainerStarted","Data":"30f49427968a8e1e701a4d21d8e7fd2b5a1fc4ae97cc631875e4c2058ae2f7bb"}
May 26 16:08:30.554166 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.554104    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerStarted","Data":"70a12ef22c4e6c7b2782669e16185e9464fb07ad7fd1776bc3f733e559bb2ea0"}
May 26 16:08:30.560965 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.560893    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9nsz" event={"ID":"3e24b597-ac2a-480d-92c2-cfeeba439dcb","Type":"ContainerStarted","Data":"8600ae41e16656a2f365bfad3971c7104f915d6dbb36e672a2026e58c76ef0d9"}
May 26 16:08:30.569373 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.569228    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6bmg" event={"ID":"94487320-4f78-45a5-8c53-c638c62c73e6","Type":"ContainerStarted","Data":"4a6c43bbd9786d20efee5834a464a4de1dfaee94a26d612befbaee17126863cb"}
May 26 16:08:30.592802 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.592763    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"503bb7e271624a6fe3b5af4e667731b4314cdf0dc44ee011fdebfa688e2375b5"}
May 26 16:08:30.600757 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.600692    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m8p7m" event={"ID":"58998204-28a6-4576-950a-eece0c4e0065","Type":"ContainerStarted","Data":"a26ced6af76e82bf5e71647f23a7c825b1b3dbad3b03e97a0c58018ca90d6ffe"}
May 26 16:08:30.606202 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.605499    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" event={"ID":"3a5e6230d598a6959a877daf9ec83d5e","Type":"ContainerStarted","Data":"21c604dd63dee8cc472b5a2014b8f1234590615800e6ff4952c99f5d1c930234"}
May 26 16:08:30.611717 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.611689    2562 generic.go:358] "Generic (PLEG): container finished" podID="4d2ca73a2516d012ff28b4918ffe4448" containerID="36dd4405e7363c7737d866b24f681a4289011a558cba9b1912dab289c6295edb" exitCode=0
May 26 16:08:30.611843 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.611774    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4d2ca73a2516d012ff28b4918ffe4448","Type":"ContainerDied","Data":"36dd4405e7363c7737d866b24f681a4289011a558cba9b1912dab289c6295edb"}
May 26 16:08:30.621428 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.621381    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-107.ec2.internal" podStartSLOduration=1.621367591 podStartE2EDuration="1.621367591s" podCreationTimestamp="2026-05-26 16:08:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:08:30.620892848 +0000 UTC m=+3.625116403" watchObservedRunningTime="2026-05-26 16:08:30.621367591 +0000 UTC m=+3.625591148"
May 26 16:08:30.628581 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.628550    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwpg4" event={"ID":"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c","Type":"ContainerStarted","Data":"7379d61ff0921d11a9098b87f82e8c2ef6c56ca5b94d5fcd333dc46507ad9841"}
May 26 16:08:30.645050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.645023    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2d7br" event={"ID":"8c276286-09d2-4549-a4f4-7b878bce45b7","Type":"ContainerStarted","Data":"06d9f5d482a0bdab20f6aee18b7e7485ac2d7c65913c47900a8afa21b4d4550c"}
May 26 16:08:30.819556 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:30.818954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:30.819556 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.819145    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:30.819556 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:30.819233    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:31.819214863 +0000 UTC m=+4.823438399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:31.024665 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.024626    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:31.024894 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.024791    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:31.024894 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.024878    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:33.024858812 +0000 UTC m=+6.029082359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:31.125885 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.125780    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:31.126051 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.125979    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:31.126051 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.126000    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:31.126051 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.126012    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:31.126211 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.126070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:08:33.126052615 +0000 UTC m=+6.130276169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:31.523346 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.523257    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:31.523493 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.523394    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:31.523894 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.523871    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:31.524321 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.523965    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:31.666408 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.666349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" event={"ID":"4d2ca73a2516d012ff28b4918ffe4448","Type":"ContainerStarted","Data":"2003fb65b472411d455dd39341554f2600551bb4958782219dae3b6589111bc3"}
May 26 16:08:31.680381 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.680328    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-107.ec2.internal" podStartSLOduration=3.680310601 podStartE2EDuration="3.680310601s" podCreationTimestamp="2026-05-26 16:08:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:08:31.679971664 +0000 UTC m=+4.684195219" watchObservedRunningTime="2026-05-26 16:08:31.680310601 +0000 UTC m=+4.684534169"
May 26 16:08:31.833078 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:31.831312    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:31.833078 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.831452    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:31.833078 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:31.831513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:33.831495358 +0000 UTC m=+6.835718908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:32.523546 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:32.523509    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:32.523733 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:32.523641    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:33.041433 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:33.041398    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:33.041899 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.041554    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:33.041899 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.041613    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:37.041595387 +0000 UTC m=+10.045818921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:33.142740 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:33.142708    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:33.142917 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.142896    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:33.143001 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.142920    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:33.143001 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.142933    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:33.143001 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.142996    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:08:37.142970812 +0000 UTC m=+10.147194360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:33.523478 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:33.523391    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:33.523644 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:33.523408    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:33.523644 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.523527    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:33.523644 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.523588    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:33.849496 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:33.849095    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:33.849496 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.849298    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:33.849496 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:33.849361    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:37.84934124 +0000 UTC m=+10.853564880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:34.523562 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:34.523021    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:34.523562 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:34.523161    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:35.523861 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:35.523172    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:35.523861 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:35.523296    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:35.523861 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:35.523706    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:35.523861 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:35.523799    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:36.522957 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:36.522742    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:36.522957 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:36.522890    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:37.075476 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:37.074882    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:37.075476 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.075061    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:37.075476 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.075129    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:45.075109617 +0000 UTC m=+18.079333172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:37.175435 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:37.175314    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:37.175620 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.175482    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:37.175620 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.175510    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:37.175620 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.175523    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:37.175620 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.175589    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:08:45.175568965 +0000 UTC m=+18.179792513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:37.524287 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:37.523764    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:37.524287 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.523886    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:37.524287 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:37.523934    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:37.524287 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.524124    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:37.880729 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:37.880635    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:37.880892 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.880836    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:37.880967 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:37.880912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:08:45.880892818 +0000 UTC m=+18.885116364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:38.523432 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:38.523400    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:38.523977 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:38.523536    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:39.523154 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:39.523111    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:39.523154 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:39.523136    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:39.523390 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:39.523259    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:39.523390 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:39.523365    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:40.522884 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:40.522850    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:40.523073 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:40.522973    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:41.523477 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:41.523442    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:41.523927 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:41.523442    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:41.523927 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:41.523574    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:41.523927 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:41.523650    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:42.523013 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:42.522973    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:42.523190 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:42.523100    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:43.523263 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:43.523174    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:43.523714 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:43.523174    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:43.523714 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:43.523296    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:43.523714 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:43.523406    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:44.522965 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:44.522935    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:44.523137 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:44.523044    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:45.137349 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:45.137313    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:45.137764 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.137449    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:45.137764 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.137521    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.137498778 +0000 UTC m=+34.141722314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:08:45.237942 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:45.237905    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:45.238117 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.238027    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:08:45.238117 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.238045    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:08:45.238117 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.238057    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:45.238117 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.238116    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.23809946 +0000 UTC m=+34.242322996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:08:45.523139 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:45.523055    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:45.523139 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:45.523108    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:45.523339 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.523197    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:45.523376 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.523339    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:45.941928 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:45.941854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:45.942051 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.942024    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 16:08:45.942106 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:45.942096    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret podName:a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.942077202 +0000 UTC m=+34.946300752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret") pod "global-pull-secret-syncer-tvfqz" (UID: "a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12") : object "kube-system"/"original-pull-secret" not registered
May 26 16:08:46.522878 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:46.522840    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:46.523335 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:46.522974    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:47.523598 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:47.523563    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:47.524025 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:47.523644    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:47.524025 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:47.523728    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:47.524025 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:47.523830    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:48.523028 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.522589    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:48.523190 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:48.523166    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:48.698235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.698195    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l" event={"ID":"10b60085-8508-4a05-af14-764fad91d29a","Type":"ContainerStarted","Data":"9d8e9562a9a52982bf777b363ffd6f23b5ffc693c50ba041e0a925162e718795"}
May 26 16:08:48.699745 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.699715    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="5698c5d96a016eb192ca3d1849c874a1e3bcbeb3ab8f2de778785158101453a3" exitCode=0
May 26 16:08:48.699883 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.699792    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"5698c5d96a016eb192ca3d1849c874a1e3bcbeb3ab8f2de778785158101453a3"}
May 26 16:08:48.701382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.701280    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6bmg" event={"ID":"94487320-4f78-45a5-8c53-c638c62c73e6","Type":"ContainerStarted","Data":"8b377c481fa4c0cea47cce6f9dfe596026f8461279d9c5c5186442c5202ad9e0"}
May 26 16:08:48.704395 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704366    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"2ced9f64385a236040a37da747828d5e6a4c317d8788f7e06ff2bd91620930a8"}
May 26 16:08:48.704482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704399    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"62d84f7bcb4752b33cd238217367867041bd7ad3e5858ae527b47f1c2954cc55"}
May 26 16:08:48.704482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704412    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"62bae5424b2faf08669c818e2f8e96d7f5492a16332a1056c475a1b65a3ea552"}
May 26 16:08:48.704482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704425    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"4830cbae3ffd78a67a888083d913ea3de22def2efeec489ea62fe726e6495129"}
May 26 16:08:48.704482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704437    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"18074895bf2a682f6a388902b593ef936e847dc32d3fc45cde2ae960ea7556e1"}
May 26 16:08:48.704482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.704448    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"8c95d04dd011c32bac882b4817909d35d6b8eda6445388b22401f9767efa0d51"}
May 26 16:08:48.705750 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.705731    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m8p7m" event={"ID":"58998204-28a6-4576-950a-eece0c4e0065","Type":"ContainerStarted","Data":"398bfd136050adc778a1be4df7d0f05becd842b8d474433438f99dac48bfecfd"}
May 26 16:08:48.706928 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.706899    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mwpg4" event={"ID":"d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c","Type":"ContainerStarted","Data":"8ac642ae98095617a8f65c67e4085d99667cea42c948826816aff9a11779b890"}
May 26 16:08:48.708330 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.708301    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2d7br" event={"ID":"8c276286-09d2-4549-a4f4-7b878bce45b7","Type":"ContainerStarted","Data":"ab5d89ab012302271a4ed4df7c4d095966c3342f85dd42dae01625c9ba82018e"}
May 26 16:08:48.709527 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.709505    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4mmb" event={"ID":"78db7de9-47fb-48e4-908e-5c3b01131daa","Type":"ContainerStarted","Data":"8465396482e53cd2c27f5da2ea939ab2bea428c9201566c7dc4fc61c9f8546a0"}
May 26 16:08:48.745898 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.745853    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2d7br" podStartSLOduration=3.993769935 podStartE2EDuration="21.745836003s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.03641342 +0000 UTC m=+3.040636956" lastFinishedPulling="2026-05-26 16:08:47.788479476 +0000 UTC m=+20.792703024" observedRunningTime="2026-05-26 16:08:48.745707592 +0000 UTC m=+21.749931148" watchObservedRunningTime="2026-05-26 16:08:48.745836003 +0000 UTC m=+21.750059560"
May 26 16:08:48.764020 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.763975    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-t6bmg" podStartSLOduration=3.992860657 podStartE2EDuration="21.763960962s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.035431137 +0000 UTC m=+3.039654678" lastFinishedPulling="2026-05-26 16:08:47.80653144 +0000 UTC m=+20.810754983" observedRunningTime="2026-05-26 16:08:48.763417684 +0000 UTC m=+21.767641253" watchObservedRunningTime="2026-05-26 16:08:48.763960962 +0000 UTC m=+21.768184517"
May 26 16:08:48.786320 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.786270    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mwpg4" podStartSLOduration=4.059706891 podStartE2EDuration="21.78625691s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.04270175 +0000 UTC m=+3.046925285" lastFinishedPulling="2026-05-26 16:08:47.769251756 +0000 UTC m=+20.773475304" observedRunningTime="2026-05-26 16:08:48.785916635 +0000 UTC m=+21.790140213" watchObservedRunningTime="2026-05-26 16:08:48.78625691 +0000 UTC m=+21.790480464"
May 26 16:08:48.805700 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.805662    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4mmb" podStartSLOduration=4.047037221 podStartE2EDuration="21.8056515s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.030061429 +0000 UTC m=+3.034284971" lastFinishedPulling="2026-05-26 16:08:47.788675703 +0000 UTC m=+20.792899250" observedRunningTime="2026-05-26 16:08:48.805498468 +0000 UTC m=+21.809722024" watchObservedRunningTime="2026-05-26 16:08:48.8056515 +0000 UTC m=+21.809875054"
May 26 16:08:48.819643 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:48.819580    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m8p7m" podStartSLOduration=4.114753161 podStartE2EDuration="21.819569054s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.031316822 +0000 UTC m=+3.035540358" lastFinishedPulling="2026-05-26 16:08:47.736132718 +0000 UTC m=+20.740356251" observedRunningTime="2026-05-26 16:08:48.819218731 +0000 UTC m=+21.823442287" watchObservedRunningTime="2026-05-26 16:08:48.819569054 +0000 UTC m=+21.823792608"
May 26 16:08:49.346285 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.346088    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 16:08:49.458201 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.458116    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T16:08:49.346281347Z","UUID":"6f627270-ee6e-4682-a2ff-de8ba840ba53","Handler":null,"Name":"","Endpoint":""}
May 26 16:08:49.461297 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.461271    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 16:08:49.461297 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.461298    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 16:08:49.522874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.522798    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:49.522874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.522857    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:49.523075 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:49.522934    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:49.523131 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:49.523074    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:49.712564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.712525    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9nsz" event={"ID":"3e24b597-ac2a-480d-92c2-cfeeba439dcb","Type":"ContainerStarted","Data":"b1591c67f06833becde4c8f485b72eaa24f88358384bf1e34cf56e123ffa79a3"}
May 26 16:08:49.714134 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.714096    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l" event={"ID":"10b60085-8508-4a05-af14-764fad91d29a","Type":"ContainerStarted","Data":"1919e41a3e3b45f91423de1d2598f9adcdc9dfd5d7de913d0b325373558355a4"}
May 26 16:08:49.728057 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:49.728020    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h9nsz" podStartSLOduration=4.974354144 podStartE2EDuration="22.728009248s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.037696087 +0000 UTC m=+3.041919638" lastFinishedPulling="2026-05-26 16:08:47.791351205 +0000 UTC m=+20.795574742" observedRunningTime="2026-05-26 16:08:49.727722287 +0000 UTC m=+22.731945843" watchObservedRunningTime="2026-05-26 16:08:49.728009248 +0000 UTC m=+22.732232803"
May 26 16:08:50.523043 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:50.523015    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:50.523234 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:50.523142    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:51.442773 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.442739    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:51.443373 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.443353    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:51.523222 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.523194    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:51.523396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.523191    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:51.523396 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:51.523313    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:51.523508 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:51.523397    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:51.719703 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.719609    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l" event={"ID":"10b60085-8508-4a05-af14-764fad91d29a","Type":"ContainerStarted","Data":"4ef91a644af1f76d4402c3652059d0f6c973c3f4d90c780a2a94e3fa1d8920dc"}
May 26 16:08:51.722791 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.722759    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"821eb1214ba57184bbe8c96829edc628de1baadb007edfa7fa9d0901dce25330"}
May 26 16:08:51.723211 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.723191    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:51.723575 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.723553    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mwpg4"
May 26 16:08:51.737226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:51.737189    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4z97l" podStartSLOduration=4.129052734 podStartE2EDuration="24.737176764s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.042462328 +0000 UTC m=+3.046685861" lastFinishedPulling="2026-05-26 16:08:50.650586358 +0000 UTC m=+23.654809891" observedRunningTime="2026-05-26 16:08:51.736768522 +0000 UTC m=+24.740992074" watchObservedRunningTime="2026-05-26 16:08:51.737176764 +0000 UTC m=+24.741400323"
May 26 16:08:52.523333 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:52.523250    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:52.524056 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:52.523391    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:53.522699 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:53.522665    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:53.522898 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:53.522670    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:53.522898 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:53.522794    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:53.522898 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:53.522881    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:54.523304 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.523097    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:54.523743 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:54.523337    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:54.730061 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.730027    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="f98716c733654b89de970f506129a715c29965a1b05f012fa05dc0791a0b76a9" exitCode=0
May 26 16:08:54.730203 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.730094    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"f98716c733654b89de970f506129a715c29965a1b05f012fa05dc0791a0b76a9"}
May 26 16:08:54.733361 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.733341    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" event={"ID":"34bae38d-5d65-4bbe-88d3-aded265be8b0","Type":"ContainerStarted","Data":"d50c6256720b174be1d1135e0cb9cf71d6b2f4f285b6b0469eefea087fc77b11"}
May 26 16:08:54.733647 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.733628    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:54.733647 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.733656    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:54.749226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.749208    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:54.780807 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:54.780774    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd" podStartSLOduration=9.953790422 podStartE2EDuration="27.780761506s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.032028572 +0000 UTC m=+3.036252121" lastFinishedPulling="2026-05-26 16:08:47.85899966 +0000 UTC m=+20.863223205" observedRunningTime="2026-05-26 16:08:54.779859548 +0000 UTC m=+27.784083104" watchObservedRunningTime="2026-05-26 16:08:54.780761506 +0000 UTC m=+27.784985061"
May 26 16:08:55.523041 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.522994    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:55.523177 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:55.523134    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:55.523177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.523155    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:55.523584 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:55.523557    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:55.704251 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.704082    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9d9d9"]
May 26 16:08:55.707522 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.707495    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7p2l"]
May 26 16:08:55.707673 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.707659    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:55.707790 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:55.707772    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:55.708022 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.708001    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvfqz"]
May 26 16:08:55.737461 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.737395    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="cf76fe519a3926c344ba9a2d6631dfb274fd003699899beef8640b0243344525" exitCode=0
May 26 16:08:55.737586 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.737491    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:55.737586 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.737496    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"cf76fe519a3926c344ba9a2d6631dfb274fd003699899beef8640b0243344525"}
May 26 16:08:55.737677 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.737594    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:55.737677 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:55.737595    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:55.737677 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:55.737664    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:55.738293 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.738240    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:55.755680 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:55.755658    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:08:56.741441 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:56.741350    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="f4016e166b805eae096b35d81ad539b10419674bda1f25ce1cff9e0c4ac0709d" exitCode=0
May 26 16:08:56.741798 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:56.741442    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"f4016e166b805eae096b35d81ad539b10419674bda1f25ce1cff9e0c4ac0709d"}
May 26 16:08:57.524007 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:57.523982    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:57.524181 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:57.524084    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:57.524181 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:57.524156    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:57.524308 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:57.524181    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:57.524308 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:57.524175    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:08:57.524308 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:57.524265    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:59.523153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:59.523122    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:08:59.523901 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:59.523124    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:08:59.523901 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:59.523250    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tvfqz" podUID="a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12"
May 26 16:08:59.523901 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:59.523338    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9d9d9" podUID="1cf33464-3a0a-4efb-824d-798640ac60de"
May 26 16:08:59.523901 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:08:59.523124    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:08:59.523901 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:08:59.523444    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:09:00.864078 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.864046    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-107.ec2.internal" event="NodeReady"
May 26 16:09:00.864712 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.864211    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 16:09:00.899847 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.899807    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"]
May 26 16:09:00.902401 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.902369    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:00.903426 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.903183    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"]
May 26 16:09:00.905228 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.905166    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:09:00.905397 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.905362    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:00.905466 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.905405    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 16:09:00.905521 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.905509    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 16:09:00.905788 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.905628    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6v9kr\""
May 26 16:09:00.906025 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.906009    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 16:09:00.906085 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.906040    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 16:09:00.906904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.906887    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"]
May 26 16:09:00.907050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.907029    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:00.908100 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.907962    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 16:09:00.908100 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.907993    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 16:09:00.908374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.908354    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 16:09:00.908665 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.908637    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 16:09:00.909028 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.908976    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:00.909962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.909724    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 16:09:00.909962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.909802    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xtgwl\""
May 26 16:09:00.909962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.909916    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 16:09:00.910187 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.910038    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 16:09:00.912434 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.911501    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 16:09:00.912621 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.912599    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"]
May 26 16:09:00.915357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.915188    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 16:09:00.915485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.915457    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hl6mg"]
May 26 16:09:00.917579 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.917555    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:00.918343 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.918322    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"]
May 26 16:09:00.921213 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.919811    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"]
May 26 16:09:00.921213 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.920387    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfl8l\""
May 26 16:09:00.921213 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.920718    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 16:09:00.921213 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.920958    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 16:09:00.921449 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.921217    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 16:09:00.924120 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.922617    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:09:00.932705 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:00.932685    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hl6mg"]
May 26 16:09:01.010523 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.010485    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jcxfn"]
May 26 16:09:01.013262 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.013224    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.015770 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.015748    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 16:09:01.015770 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.015767    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfnx9\""
May 26 16:09:01.015943 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.015792    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 16:09:01.023865 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.023839    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jcxfn"]
May 26 16:09:01.050363 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmrz4\" (UniqueName: \"kubernetes.io/projected/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-kube-api-access-qmrz4\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.050491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.050491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050650 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050650 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050650 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-tmp\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.050650 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.050841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a07055da-60f3-455c-8da6-89fe494ad315-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.050841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.050841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.050841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgz5\" (UniqueName: \"kubernetes.io/projected/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-kube-api-access-bdgz5\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlsj\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-klusterlet-config\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.050997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzgs7\" (UniqueName: \"kubernetes.io/projected/a07055da-60f3-455c-8da6-89fe494ad315-kube-api-access-dzgs7\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.051028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.051099 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.051054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsrjr\" (UniqueName: \"kubernetes.io/projected/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-kube-api-access-qsrjr\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.151694 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151600    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a07055da-60f3-455c-8da6-89fe494ad315-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.151694 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151649    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.151694 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03c5578-1ea9-4b62-866a-14224b592c0e-tmp-dir\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151701    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151725    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.151751    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.151795    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.151832    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.151849    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.151912    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.651889964 +0000 UTC m=+34.656113511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:01.152003 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.151933    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.65192513 +0000 UTC m=+34.656148667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:01.152373 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152261    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.152373 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152298    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgz5\" (UniqueName: \"kubernetes.io/projected/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-kube-api-access-bdgz5\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.152373 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152327    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03c5578-1ea9-4b62-866a-14224b592c0e-config-volume\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.152519 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.152519 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152498    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.152662 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152531    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlsj\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.152662 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152558    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-klusterlet-config\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.152662 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152601    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dzgs7\" (UniqueName: \"kubernetes.io/projected/a07055da-60f3-455c-8da6-89fe494ad315-kube-api-access-dzgs7\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.152662 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152638    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152665    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qsrjr\" (UniqueName: \"kubernetes.io/projected/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-kube-api-access-qsrjr\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152691    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmrz4\" (UniqueName: \"kubernetes.io/projected/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-kube-api-access-qmrz4\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k2s5\" (UniqueName: \"kubernetes.io/projected/f03c5578-1ea9-4b62-866a-14224b592c0e-kube-api-access-2k2s5\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152754    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152782    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.152875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.153177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152881    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:09:01.153177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152906    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.153177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152932    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.153177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152953    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-tmp\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.153177 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152976    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.154203 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.153856    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:09:01.154203 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.153926    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:33.153908248 +0000 UTC m=+66.158131788 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 16:09:01.154203 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.153926    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.154203 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.152780    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.154672 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.154502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.155024 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.154991    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.155317 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.155295    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-tmp\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.157255 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.157255 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-klusterlet-config\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.157612 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.157714 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.157776 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.157853 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a07055da-60f3-455c-8da6-89fe494ad315-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.157919 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.157866    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-ca\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.158628 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.158603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.166207 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.166183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.167184 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.167130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlsj\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.167693 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.167657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzgs7\" (UniqueName: \"kubernetes.io/projected/a07055da-60f3-455c-8da6-89fe494ad315-kube-api-access-dzgs7\") pod \"managed-serviceaccount-addon-agent-74fbf564d6-bvxd6\" (UID: \"a07055da-60f3-455c-8da6-89fe494ad315\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.167693 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.167683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmrz4\" (UniqueName: \"kubernetes.io/projected/f827e7b0-6a9a-472a-a770-7e4e3d6537a0-kube-api-access-qmrz4\") pod \"cluster-proxy-proxy-agent-c87b96cb4-b6ftr\" (UID: \"f827e7b0-6a9a-472a-a770-7e4e3d6537a0\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.168220 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.168197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsrjr\" (UniqueName: \"kubernetes.io/projected/63b40594-08d5-4ea7-9ee7-ba92c28b93e2-kube-api-access-qsrjr\") pod \"klusterlet-addon-workmgr-788646cb4d-8cfzr\" (UID: \"63b40594-08d5-4ea7-9ee7-ba92c28b93e2\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.168382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.168362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgz5\" (UniqueName: \"kubernetes.io/projected/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-kube-api-access-bdgz5\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.227139 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.227103    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"
May 26 16:09:01.236019 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.235991    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:09:01.254051 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254004    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254066    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03c5578-1ea9-4b62-866a-14224b592c0e-tmp-dir\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03c5578-1ea9-4b62-866a-14224b592c0e-config-volume\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254128    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254133    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254158    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254165    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2k2s5\" (UniqueName: \"kubernetes.io/projected/f03c5578-1ea9-4b62-866a-14224b592c0e-kube-api-access-2k2s5\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.254175 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254171    2562 projected.go:194] Error preparing data for projected volume kube-api-access-r56tr for pod openshift-network-diagnostics/network-check-target-9d9d9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:09:01.254482 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254228    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr podName:1cf33464-3a0a-4efb-824d-798640ac60de nodeName:}" failed. No retries permitted until 2026-05-26 16:09:33.254206929 +0000 UTC m=+66.258430464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r56tr" (UniqueName: "kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr") pod "network-check-target-9d9d9" (UID: "1cf33464-3a0a-4efb-824d-798640ac60de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 16:09:01.254482 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254255    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:01.254482 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.254301    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:01.75428837 +0000 UTC m=+34.758511903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:01.254482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f03c5578-1ea9-4b62-866a-14224b592c0e-tmp-dir\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.254724 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.254683    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f03c5578-1ea9-4b62-866a-14224b592c0e-config-volume\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.255925 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.255902    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:01.263271 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.263251    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k2s5\" (UniqueName: \"kubernetes.io/projected/f03c5578-1ea9-4b62-866a-14224b592c0e-kube-api-access-2k2s5\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.523131 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.523044    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:09:01.523131 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.523069    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:01.523131 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.523128    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:09:01.526221 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526190    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:09:01.526357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526251    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f72wj\""
May 26 16:09:01.526357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526267    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 16:09:01.526357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526280    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:09:01.526357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526299    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s662\""
May 26 16:09:01.526564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.526389    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 16:09:01.656632 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.656585    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:01.656632 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.656634    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:01.656883 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.656725    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:01.656883 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.656746    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:01.656883 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.656765    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:01.656883 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.656809    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:02.656788169 +0000 UTC m=+35.661011705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:01.656883 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.656845    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:02.656835139 +0000 UTC m=+35.661058679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:01.757637 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.757605    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:01.757844 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.757737    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:01.757844 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:01.757807    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:02.757788118 +0000 UTC m=+35.762011663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:01.959897 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.958992    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:09:01.964257 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:01.964234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12-original-pull-secret\") pod \"global-pull-secret-syncer-tvfqz\" (UID: \"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12\") " pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:09:02.136798 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.136758    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tvfqz"
May 26 16:09:02.665122 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.665085    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:02.665284 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.665262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:02.665385 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.665362    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:02.665457 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.665429    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:02.665457 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.665446    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:02.665559 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.665455    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:04.665433681 +0000 UTC m=+37.669657238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:02.665559 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.665503    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:04.665487129 +0000 UTC m=+37.669710662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:02.766841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.766426    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:02.766841 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.766557    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:02.766841 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:02.766609    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:04.766595338 +0000 UTC m=+37.770818876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:02.826807 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.826778    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6"]
May 26 16:09:02.831243 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.831214    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tvfqz"]
May 26 16:09:02.837397 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:09:02.837261    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4bdf3eb_14ae_415f_b8f8_f7b4c0977f12.slice/crio-e4e85a51e8fe8472ae4d54aa8b6600e210f58a1b0601af0f39435bcd9b828676 WatchSource:0}: Error finding container e4e85a51e8fe8472ae4d54aa8b6600e210f58a1b0601af0f39435bcd9b828676: Status 404 returned error can't find the container with id e4e85a51e8fe8472ae4d54aa8b6600e210f58a1b0601af0f39435bcd9b828676
May 26 16:09:02.842106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.842084    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"]
May 26 16:09:02.844477 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:02.844453    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"]
May 26 16:09:02.845808 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:09:02.845785    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf827e7b0_6a9a_472a_a770_7e4e3d6537a0.slice/crio-bcf87cbabe9235531cfc6fb3270da0b4b4ffd1efbccf0f9910f1a379a1be25ab WatchSource:0}: Error finding container bcf87cbabe9235531cfc6fb3270da0b4b4ffd1efbccf0f9910f1a379a1be25ab: Status 404 returned error can't find the container with id bcf87cbabe9235531cfc6fb3270da0b4b4ffd1efbccf0f9910f1a379a1be25ab
May 26 16:09:02.848111 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:09:02.848086    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b40594_08d5_4ea7_9ee7_ba92c28b93e2.slice/crio-f9f18c87f6002c6aeec9ee00cd6a661fd6aab9ef5506ae7eabe3c24ba8cb5393 WatchSource:0}: Error finding container f9f18c87f6002c6aeec9ee00cd6a661fd6aab9ef5506ae7eabe3c24ba8cb5393: Status 404 returned error can't find the container with id f9f18c87f6002c6aeec9ee00cd6a661fd6aab9ef5506ae7eabe3c24ba8cb5393
May 26 16:09:03.758520 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.758255    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvfqz" event={"ID":"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12","Type":"ContainerStarted","Data":"e4e85a51e8fe8472ae4d54aa8b6600e210f58a1b0601af0f39435bcd9b828676"}
May 26 16:09:03.759891 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.759853    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerStarted","Data":"bcf87cbabe9235531cfc6fb3270da0b4b4ffd1efbccf0f9910f1a379a1be25ab"}
May 26 16:09:03.760970 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.760946    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr" event={"ID":"63b40594-08d5-4ea7-9ee7-ba92c28b93e2","Type":"ContainerStarted","Data":"f9f18c87f6002c6aeec9ee00cd6a661fd6aab9ef5506ae7eabe3c24ba8cb5393"}
May 26 16:09:03.764307 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.764207    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="70197bf86154cf60a6af071b9b2e1f0539f297fca89bf636183c733f7ca42523" exitCode=0
May 26 16:09:03.764307 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.764274    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"70197bf86154cf60a6af071b9b2e1f0539f297fca89bf636183c733f7ca42523"}
May 26 16:09:03.765899 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:03.765872    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6" event={"ID":"a07055da-60f3-455c-8da6-89fe494ad315","Type":"ContainerStarted","Data":"d12ef57c80079a4226efeb6f60ea42c990faa9dd9a2d634511017cc9706b9769"}
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:04.680731    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:04.680889    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.681011    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.681025    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.681082    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:08.681064406 +0000 UTC m=+41.685287945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.681548    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:04.681637 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.681600    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:08.681583179 +0000 UTC m=+41.685806727 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:04.773162 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:04.773109    2562 generic.go:358] "Generic (PLEG): container finished" podID="7b92edc4-3414-47c2-8de0-c137f9ebcc59" containerID="bfa100300b7c6c784d5498af66c5425316e26235778dfcac858495a3860241e7" exitCode=0
May 26 16:09:04.773947 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:04.773188    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerDied","Data":"bfa100300b7c6c784d5498af66c5425316e26235778dfcac858495a3860241e7"}
May 26 16:09:04.781973 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:04.781490    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:04.781973 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.781639    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:04.781973 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:04.781698    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:08.7816713 +0000 UTC m=+41.785894846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:05.780009 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:05.779968    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" event={"ID":"7b92edc4-3414-47c2-8de0-c137f9ebcc59","Type":"ContainerStarted","Data":"b97621337c481fb9c7fee945fc32a992105a94818632a8c209b84cf196cee1eb"}
May 26 16:09:05.807220 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:05.807120    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hpr5z" podStartSLOduration=6.074502097 podStartE2EDuration="38.807103488s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:08:30.040515107 +0000 UTC m=+3.044738642" lastFinishedPulling="2026-05-26 16:09:02.773116489 +0000 UTC m=+35.777340033" observedRunningTime="2026-05-26 16:09:05.805765389 +0000 UTC m=+38.809988947" watchObservedRunningTime="2026-05-26 16:09:05.807103488 +0000 UTC m=+38.811327044"
May 26 16:09:08.717582 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:08.717539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:08.717598    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.717704    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.717724    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.717702    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.717793    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:16.71777673 +0000 UTC m=+49.722000266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:08.718098 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.717913    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:16.71789319 +0000 UTC m=+49.722116738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:08.818800 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:08.818765    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:08.818968 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.818933    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:08.819049 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:08.819014    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:16.818985097 +0000 UTC m=+49.823208639 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:12.798217 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:12.798184    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerStarted","Data":"4a7775a6da3e0635a829195ff87b40f036c6ae13f0c7257f42d3d9bd2d62a23e"}
May 26 16:09:13.802235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.802194    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6" event={"ID":"a07055da-60f3-455c-8da6-89fe494ad315","Type":"ContainerStarted","Data":"adad3f9fb1ae95992274d1446c048c4f67711004e7434a7750adddca7aaaead0"}
May 26 16:09:13.803699 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.803625    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tvfqz" event={"ID":"a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12","Type":"ContainerStarted","Data":"dab88fd8bed23f7e7750680eb0a4699247e7f6d03592ff5ded4b55a144172219"}
May 26 16:09:13.804960 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.804926    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr" event={"ID":"63b40594-08d5-4ea7-9ee7-ba92c28b93e2","Type":"ContainerStarted","Data":"4641386b59822f64958b0a424e5cc251f1fb2f9b909ae87ab08e3830cc91674a"}
May 26 16:09:13.805169 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.805152    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:13.806942 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.806922    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:09:13.825284 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.825227    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6" podStartSLOduration=9.011532117 podStartE2EDuration="18.825210827s" podCreationTimestamp="2026-05-26 16:08:55 +0000 UTC" firstStartedPulling="2026-05-26 16:09:02.83648544 +0000 UTC m=+35.840708973" lastFinishedPulling="2026-05-26 16:09:12.650164144 +0000 UTC m=+45.654387683" observedRunningTime="2026-05-26 16:09:13.824384451 +0000 UTC m=+46.828608011" watchObservedRunningTime="2026-05-26 16:09:13.825210827 +0000 UTC m=+46.829434394"
May 26 16:09:13.842520 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:13.842478    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr" podStartSLOduration=8.996447818 podStartE2EDuration="18.842465576s" podCreationTimestamp="2026-05-26 16:08:55 +0000 UTC" firstStartedPulling="2026-05-26 16:09:02.850028459 +0000 UTC m=+35.854251995" lastFinishedPulling="2026-05-26 16:09:12.696046217 +0000 UTC m=+45.700269753" observedRunningTime="2026-05-26 16:09:13.841659489 +0000 UTC m=+46.845883045" watchObservedRunningTime="2026-05-26 16:09:13.842465576 +0000 UTC m=+46.846689133"
May 26 16:09:15.811110 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:15.811068    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerStarted","Data":"56efeebf20117396d7235ef63e6360a891136a082857522d200819cf7d49f540"}
May 26 16:09:15.811110 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:15.811112    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerStarted","Data":"da5a6f5528ece3bb1eca731035e22c4b21333c6aa44a3a36833eee00a96c2d5d"}
May 26 16:09:15.830895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:15.830848    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" podStartSLOduration=8.935561646 podStartE2EDuration="20.830832925s" podCreationTimestamp="2026-05-26 16:08:55 +0000 UTC" firstStartedPulling="2026-05-26 16:09:02.847880901 +0000 UTC m=+35.852104449" lastFinishedPulling="2026-05-26 16:09:14.74315219 +0000 UTC m=+47.747375728" observedRunningTime="2026-05-26 16:09:15.829494142 +0000 UTC m=+48.833717697" watchObservedRunningTime="2026-05-26 16:09:15.830832925 +0000 UTC m=+48.835056481"
May 26 16:09:15.831226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:15.831195    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tvfqz" podStartSLOduration=35.987949082 podStartE2EDuration="45.831186247s" podCreationTimestamp="2026-05-26 16:08:30 +0000 UTC" firstStartedPulling="2026-05-26 16:09:02.838881216 +0000 UTC m=+35.843104754" lastFinishedPulling="2026-05-26 16:09:12.682118383 +0000 UTC m=+45.686341919" observedRunningTime="2026-05-26 16:09:13.856309343 +0000 UTC m=+46.860532898" watchObservedRunningTime="2026-05-26 16:09:15.831186247 +0000 UTC m=+48.835409801"
May 26 16:09:16.781960 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:16.781926    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:16.781960 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:16.781964    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:16.782160 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.782076    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:16.782160 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.782103    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:16.782160 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.782083    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:16.782256 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.782174    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:09:32.782160068 +0000 UTC m=+65.786383602 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:16.782256 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.782189    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:09:32.782183145 +0000 UTC m=+65.786406677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:16.882714 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:16.882667    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:16.883224 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.882845    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:16.883224 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:16.882911    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:09:32.882891697 +0000 UTC m=+65.887115244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:27.753682 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:27.753654    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hbstd"
May 26 16:09:32.796979 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:32.796941    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:09:32.796979 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:32.796979    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:09:32.797389 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.797083    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:09:32.797389 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.797087    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:09:32.797389 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.797104    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:09:32.797389 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.797133    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:04.797119058 +0000 UTC m=+97.801342591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:09:32.797389 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.797158    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:10:04.79714468 +0000 UTC m=+97.801368218 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:09:32.897336 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:32.897302    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:09:32.897481 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.897440    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:09:32.897524 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:32.897499    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:10:04.897485529 +0000 UTC m=+97.901709067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:09:33.199875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.199780    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:09:33.202275 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.202257    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 16:09:33.210276 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:33.210262    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 16:09:33.210334 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:09:33.210321    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:10:37.21030524 +0000 UTC m=+130.214528778 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : secret "metrics-daemon-secret" not found
May 26 16:09:33.301241 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.301210    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:33.303990 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.303975    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 16:09:33.314289 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.314272    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 16:09:33.325825 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.325802    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r56tr\" (UniqueName: \"kubernetes.io/projected/1cf33464-3a0a-4efb-824d-798640ac60de-kube-api-access-r56tr\") pod \"network-check-target-9d9d9\" (UID: \"1cf33464-3a0a-4efb-824d-798640ac60de\") " pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:33.344910 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.344888    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f72wj\""
May 26 16:09:33.353005 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.352991    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:33.474107 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.472250    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9d9d9"]
May 26 16:09:33.476784 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:09:33.476755    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf33464_3a0a_4efb_824d_798640ac60de.slice/crio-ea12785efc55cdd88d97b35ea8cb745458327a3a2063c7aef598902036775029 WatchSource:0}: Error finding container ea12785efc55cdd88d97b35ea8cb745458327a3a2063c7aef598902036775029: Status 404 returned error can't find the container with id ea12785efc55cdd88d97b35ea8cb745458327a3a2063c7aef598902036775029
May 26 16:09:33.853260 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:33.853220    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9d9d9" event={"ID":"1cf33464-3a0a-4efb-824d-798640ac60de","Type":"ContainerStarted","Data":"ea12785efc55cdd88d97b35ea8cb745458327a3a2063c7aef598902036775029"}
May 26 16:09:36.863971 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:36.863929    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9d9d9" event={"ID":"1cf33464-3a0a-4efb-824d-798640ac60de","Type":"ContainerStarted","Data":"4c66287ac2654e332cd19fb12a50545661e4350d29aeba14fba098e1dd1163da"}
May 26 16:09:36.864408 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:36.864162    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:09:36.880144 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:09:36.880098    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9d9d9" podStartSLOduration=67.076697989 podStartE2EDuration="1m9.880084518s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:09:33.478596124 +0000 UTC m=+66.482819660" lastFinishedPulling="2026-05-26 16:09:36.281982653 +0000 UTC m=+69.286206189" observedRunningTime="2026-05-26 16:09:36.879606943 +0000 UTC m=+69.883830499" watchObservedRunningTime="2026-05-26 16:09:36.880084518 +0000 UTC m=+69.884308064"
May 26 16:10:04.832012 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:04.831976    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:04.832092    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.832116    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.832191    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert podName:3d7241ac-276d-4b22-9bc2-09cdb5b922d2 nodeName:}" failed. No retries permitted until 2026-05-26 16:11:08.832176212 +0000 UTC m=+161.836399745 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert") pod "ingress-canary-hl6mg" (UID: "3d7241ac-276d-4b22-9bc2-09cdb5b922d2") : secret "canary-serving-cert" not found
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.832204    2562 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.832220    2562 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c546467c6-2b5nb: secret "image-registry-tls" not found
May 26 16:10:04.832530 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.832288    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls podName:e1abd347-a158-4ebd-bb07-3ad79deef17c nodeName:}" failed. No retries permitted until 2026-05-26 16:11:08.832271697 +0000 UTC m=+161.836495240 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls") pod "image-registry-7c546467c6-2b5nb" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c") : secret "image-registry-tls" not found
May 26 16:10:04.933020 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:04.932986    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:10:04.933179 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.933131    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 16:10:04.933219 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:04.933193    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls podName:f03c5578-1ea9-4b62-866a-14224b592c0e nodeName:}" failed. No retries permitted until 2026-05-26 16:11:08.93317398 +0000 UTC m=+161.937397529 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls") pod "dns-default-jcxfn" (UID: "f03c5578-1ea9-4b62-866a-14224b592c0e") : secret "dns-default-metrics-tls" not found
May 26 16:10:07.868796 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:07.868763    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9d9d9"
May 26 16:10:37.271892 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:37.271847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:10:37.272350 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:37.271981    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 16:10:37.272350 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:10:37.272040    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs podName:701d28a7-dc07-49e0-9e8a-60a836437170 nodeName:}" failed. No retries permitted until 2026-05-26 16:12:39.272023778 +0000 UTC m=+252.276247312 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs") pod "network-metrics-daemon-v7p2l" (UID: "701d28a7-dc07-49e0-9e8a-60a836437170") : secret "metrics-daemon-secret" not found
May 26 16:10:47.719008 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:47.718982    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4mmb_78db7de9-47fb-48e4-908e-5c3b01131daa/dns-node-resolver/0.log"
May 26 16:10:48.709951 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:10:48.709922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m8p7m_58998204-28a6-4576-950a-eece0c4e0065/node-ca/0.log"
May 26 16:11:03.949291 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:11:03.949250    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c"
May 26 16:11:03.962456 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:11:03.962428    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-hl6mg" podUID="3d7241ac-276d-4b22-9bc2-09cdb5b922d2"
May 26 16:11:04.024250 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:11:04.024209    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-jcxfn" podUID="f03c5578-1ea9-4b62-866a-14224b592c0e"
May 26 16:11:04.069305 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:04.069278    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:04.069445 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:04.069278    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:04.069503 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:04.069283    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:11:04.547732 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:11:04.547680    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-v7p2l" podUID="701d28a7-dc07-49e0-9e8a-60a836437170"
May 26 16:11:06.087461 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.087430    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w6ml6"]
May 26 16:11:06.090377 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.090362    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.092837 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.092803    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 16:11:06.093872 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.093854    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 16:11:06.093958 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.093867    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 16:11:06.093958 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.093941    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ppj7g\""
May 26 16:11:06.094069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.093958    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 16:11:06.103403 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.103383    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6ml6"]
May 26 16:11:06.175951 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.175923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6tqj\" (UniqueName: \"kubernetes.io/projected/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-api-access-d6tqj\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.176082 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.175971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64341843-9ef4-4331-9f15-b5ceb91665f5-crio-socket\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.176082 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.175993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64341843-9ef4-4331-9f15-b5ceb91665f5-data-volume\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.176202 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.176114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.176202 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.176175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64341843-9ef4-4331-9f15-b5ceb91665f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277172 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277145    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64341843-9ef4-4331-9f15-b5ceb91665f5-crio-socket\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277180    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64341843-9ef4-4331-9f15-b5ceb91665f5-data-volume\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277238    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64341843-9ef4-4331-9f15-b5ceb91665f5-crio-socket\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277284    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64341843-9ef4-4331-9f15-b5ceb91665f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d6tqj\" (UniqueName: \"kubernetes.io/projected/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-api-access-d6tqj\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277654 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277627    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64341843-9ef4-4331-9f15-b5ceb91665f5-data-volume\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.277874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.277853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.279629 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.279612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64341843-9ef4-4331-9f15-b5ceb91665f5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.286889 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.286869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6tqj\" (UniqueName: \"kubernetes.io/projected/64341843-9ef4-4331-9f15-b5ceb91665f5-kube-api-access-d6tqj\") pod \"insights-runtime-extractor-w6ml6\" (UID: \"64341843-9ef4-4331-9f15-b5ceb91665f5\") " pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.398604 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.398506    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w6ml6"
May 26 16:11:06.520153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:06.520127    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w6ml6"]
May 26 16:11:06.522533 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:11:06.522502    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64341843_9ef4_4331_9f15_b5ceb91665f5.slice/crio-e880a608dfcf39c1ade59b1f9ea5a62adc601653a0e7e616f330be17f6bfe758 WatchSource:0}: Error finding container e880a608dfcf39c1ade59b1f9ea5a62adc601653a0e7e616f330be17f6bfe758: Status 404 returned error can't find the container with id e880a608dfcf39c1ade59b1f9ea5a62adc601653a0e7e616f330be17f6bfe758
May 26 16:11:07.077564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:07.077520    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6ml6" event={"ID":"64341843-9ef4-4331-9f15-b5ceb91665f5","Type":"ContainerStarted","Data":"9bc299ce400b289cdf6b97839214480bb10e881a7cde94c3f99ae269fed560a3"}
May 26 16:11:07.077564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:07.077567    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6ml6" event={"ID":"64341843-9ef4-4331-9f15-b5ceb91665f5","Type":"ContainerStarted","Data":"e880a608dfcf39c1ade59b1f9ea5a62adc601653a0e7e616f330be17f6bfe758"}
May 26 16:11:08.082405 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.082368    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6ml6" event={"ID":"64341843-9ef4-4331-9f15-b5ceb91665f5","Type":"ContainerStarted","Data":"4594d293d60f770b78b65856e1050bd5393d2b61613097a11b4d2787abb9185d"}
May 26 16:11:08.898105 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.898013    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:11:08.898105 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.898066    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:08.900339 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.900317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d7241ac-276d-4b22-9bc2-09cdb5b922d2-cert\") pod \"ingress-canary-hl6mg\" (UID: \"3d7241ac-276d-4b22-9bc2-09cdb5b922d2\") " pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:11:08.900496 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.900477    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"image-registry-7c546467c6-2b5nb\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") " pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:08.999340 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:08.999316    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:09.001324 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.001306    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f03c5578-1ea9-4b62-866a-14224b592c0e-metrics-tls\") pod \"dns-default-jcxfn\" (UID: \"f03c5578-1ea9-4b62-866a-14224b592c0e\") " pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:09.085784 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.085745    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w6ml6" event={"ID":"64341843-9ef4-4331-9f15-b5ceb91665f5","Type":"ContainerStarted","Data":"c8085c3ed250fbd849253d18f3c5fc425a07a049dafe780147a07df081b9a312"}
May 26 16:11:09.105706 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.105659    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w6ml6" podStartSLOduration=1.13773902 podStartE2EDuration="3.105646714s" podCreationTimestamp="2026-05-26 16:11:06 +0000 UTC" firstStartedPulling="2026-05-26 16:11:06.574395072 +0000 UTC m=+159.578618609" lastFinishedPulling="2026-05-26 16:11:08.54230277 +0000 UTC m=+161.546526303" observedRunningTime="2026-05-26 16:11:09.104215775 +0000 UTC m=+162.108439330" watchObservedRunningTime="2026-05-26 16:11:09.105646714 +0000 UTC m=+162.109870285"
May 26 16:11:09.172384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.172304    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xtgwl\""
May 26 16:11:09.172384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.172326    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfnx9\""
May 26 16:11:09.172384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.172367    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dfl8l\""
May 26 16:11:09.180504 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.180482    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hl6mg"
May 26 16:11:09.180603 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.180505    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:09.180603 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.180593    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:09.320733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.320699    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:11:09.325223 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:11:09.325192    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1abd347_a158_4ebd_bb07_3ad79deef17c.slice/crio-a9577fec5196c6eb82a4a8b1600d3064b7c84414c367d98125401bc0dd0fa14e WatchSource:0}: Error finding container a9577fec5196c6eb82a4a8b1600d3064b7c84414c367d98125401bc0dd0fa14e: Status 404 returned error can't find the container with id a9577fec5196c6eb82a4a8b1600d3064b7c84414c367d98125401bc0dd0fa14e
May 26 16:11:09.540286 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.540258    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hl6mg"]
May 26 16:11:09.545092 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:09.545063    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jcxfn"]
May 26 16:11:09.550538 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:11:09.550506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03c5578_1ea9_4b62_866a_14224b592c0e.slice/crio-9d08eebfb2f7aef26958cf2583003a94d96346681dfc2259e030bf98ef993a29 WatchSource:0}: Error finding container 9d08eebfb2f7aef26958cf2583003a94d96346681dfc2259e030bf98ef993a29: Status 404 returned error can't find the container with id 9d08eebfb2f7aef26958cf2583003a94d96346681dfc2259e030bf98ef993a29
May 26 16:11:10.090415 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.090371    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" event={"ID":"e1abd347-a158-4ebd-bb07-3ad79deef17c","Type":"ContainerStarted","Data":"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"}
May 26 16:11:10.090415 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.090420    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" event={"ID":"e1abd347-a158-4ebd-bb07-3ad79deef17c","Type":"ContainerStarted","Data":"a9577fec5196c6eb82a4a8b1600d3064b7c84414c367d98125401bc0dd0fa14e"}
May 26 16:11:10.091051 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.090600    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:10.091610 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.091575    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcxfn" event={"ID":"f03c5578-1ea9-4b62-866a-14224b592c0e","Type":"ContainerStarted","Data":"9d08eebfb2f7aef26958cf2583003a94d96346681dfc2259e030bf98ef993a29"}
May 26 16:11:10.092628 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.092597    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hl6mg" event={"ID":"3d7241ac-276d-4b22-9bc2-09cdb5b922d2","Type":"ContainerStarted","Data":"fdd08c15b587045440a7df00c8eca2737989405e689bb1ceeafd3d5e0839065b"}
May 26 16:11:10.112077 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:10.112031    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" podStartSLOduration=162.112017359 podStartE2EDuration="2m42.112017359s" podCreationTimestamp="2026-05-26 16:08:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:11:10.110261841 +0000 UTC m=+163.114485432" watchObservedRunningTime="2026-05-26 16:11:10.112017359 +0000 UTC m=+163.116240916"
May 26 16:11:12.100074 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.100036    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcxfn" event={"ID":"f03c5578-1ea9-4b62-866a-14224b592c0e","Type":"ContainerStarted","Data":"3aaa36124b84cfd1a2a5f681bf9b7e9add19aec6375d890fd72526e4290b1564"}
May 26 16:11:12.100074 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.100079    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jcxfn" event={"ID":"f03c5578-1ea9-4b62-866a-14224b592c0e","Type":"ContainerStarted","Data":"98aef70665a2dfe502993e79a2b4645c3e4ceb219bfad3b0d91c230ae9fdc9cd"}
May 26 16:11:12.100545 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.100162    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:12.101346 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.101321    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hl6mg" event={"ID":"3d7241ac-276d-4b22-9bc2-09cdb5b922d2","Type":"ContainerStarted","Data":"b39fb7db3db06aef75f85db4e3eecf6a6ec38622831ed05e4349923f4e78a52b"}
May 26 16:11:12.117740 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.117699    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-jcxfn" podStartSLOduration=129.986121286 podStartE2EDuration="2m12.117686459s" podCreationTimestamp="2026-05-26 16:09:00 +0000 UTC" firstStartedPulling="2026-05-26 16:11:09.552171109 +0000 UTC m=+162.556394642" lastFinishedPulling="2026-05-26 16:11:11.683736279 +0000 UTC m=+164.687959815" observedRunningTime="2026-05-26 16:11:12.116970007 +0000 UTC m=+165.121193563" watchObservedRunningTime="2026-05-26 16:11:12.117686459 +0000 UTC m=+165.121910014"
May 26 16:11:12.132837 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:12.132782    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hl6mg" podStartSLOduration=129.993371063 podStartE2EDuration="2m12.132769281s" podCreationTimestamp="2026-05-26 16:09:00 +0000 UTC" firstStartedPulling="2026-05-26 16:11:09.548096123 +0000 UTC m=+162.552319657" lastFinishedPulling="2026-05-26 16:11:11.687494338 +0000 UTC m=+164.691717875" observedRunningTime="2026-05-26 16:11:12.132437006 +0000 UTC m=+165.136660563" watchObservedRunningTime="2026-05-26 16:11:12.132769281 +0000 UTC m=+165.136992836"
May 26 16:11:13.105622 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.105586    2562 generic.go:358] "Generic (PLEG): container finished" podID="a07055da-60f3-455c-8da6-89fe494ad315" containerID="adad3f9fb1ae95992274d1446c048c4f67711004e7434a7750adddca7aaaead0" exitCode=255
May 26 16:11:13.106056 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.105662    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6" event={"ID":"a07055da-60f3-455c-8da6-89fe494ad315","Type":"ContainerDied","Data":"adad3f9fb1ae95992274d1446c048c4f67711004e7434a7750adddca7aaaead0"}
May 26 16:11:13.106056 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.105999    2562 scope.go:117] "RemoveContainer" containerID="adad3f9fb1ae95992274d1446c048c4f67711004e7434a7750adddca7aaaead0"
May 26 16:11:13.107039 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.107015    2562 generic.go:358] "Generic (PLEG): container finished" podID="63b40594-08d5-4ea7-9ee7-ba92c28b93e2" containerID="4641386b59822f64958b0a424e5cc251f1fb2f9b909ae87ab08e3830cc91674a" exitCode=1
May 26 16:11:13.107161 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.107078    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr" event={"ID":"63b40594-08d5-4ea7-9ee7-ba92c28b93e2","Type":"ContainerDied","Data":"4641386b59822f64958b0a424e5cc251f1fb2f9b909ae87ab08e3830cc91674a"}
May 26 16:11:13.107606 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.107590    2562 scope.go:117] "RemoveContainer" containerID="4641386b59822f64958b0a424e5cc251f1fb2f9b909ae87ab08e3830cc91674a"
May 26 16:11:13.805487 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:13.805452    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:11:14.110439 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:14.110334    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr" event={"ID":"63b40594-08d5-4ea7-9ee7-ba92c28b93e2","Type":"ContainerStarted","Data":"34dcf0e825a6352b80377e0a3fb30ae3ffb40a7d6ea9d406aa1f55faaad5e992"}
May 26 16:11:14.110910 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:14.110498    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:11:14.111202 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:14.111180    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-788646cb4d-8cfzr"
May 26 16:11:14.111977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:14.111956    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-74fbf564d6-bvxd6" event={"ID":"a07055da-60f3-455c-8da6-89fe494ad315","Type":"ContainerStarted","Data":"eda15e0fa0fa652c638303e1367c0b1542b40e8ef27b4905fb3eb1f8dd890c23"}
May 26 16:11:18.523488 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:18.523397    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:11:22.109439 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:22.109410    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jcxfn"
May 26 16:11:28.481278 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:28.481245    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:11:28.485333 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:28.485303    2562 patch_prober.go:28] interesting pod/image-registry-7c546467c6-2b5nb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 16:11:28.485482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:28.485353    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 16:11:34.541143 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.541111    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8tg9b"]
May 26 16:11:34.544788 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.544767    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.548648 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.548626    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 16:11:34.548763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.548628    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 16:11:34.548763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.548627    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-khbg7\""
May 26 16:11:34.548763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.548627    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 16:11:34.548763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.548628    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 16:11:34.549078 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.549062    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 16:11:34.549174 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.549157    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 16:11:34.683737 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.683937 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-metrics-client-ca\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.683937 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-textfile\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.683937 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-tls\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.683937 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-wtmp\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.683937 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-root\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.684106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rq5\" (UniqueName: \"kubernetes.io/projected/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-kube-api-access-x2rq5\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.684106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.683975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-accelerators-collector-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.684106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.684007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-sys\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785371 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785336    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-wtmp\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785371 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785373    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-root\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785402    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rq5\" (UniqueName: \"kubernetes.io/projected/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-kube-api-access-x2rq5\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785428    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-accelerators-collector-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-root\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785466    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-sys\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-sys\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-wtmp\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785564 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785551    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785804 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785581    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-metrics-client-ca\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785804 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785614    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-textfile\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785804 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785636    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-tls\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.785957 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.785902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-textfile\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.786154 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.786120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-accelerators-collector-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.786154 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.786139    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-metrics-client-ca\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.787686 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.787665    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.787898 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.787879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-node-exporter-tls\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.793486 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.793438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rq5\" (UniqueName: \"kubernetes.io/projected/3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78-kube-api-access-x2rq5\") pod \"node-exporter-8tg9b\" (UID: \"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78\") " pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.854290 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:34.854263    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8tg9b"
May 26 16:11:34.862961 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:11:34.862937    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e24bda6_b93a_4536_bf8f_f3bb3b2c1e78.slice/crio-d3639a4e33befe4f3f673a824f61dcb42c7c73aae3b9148fd7ce40cbd2734419 WatchSource:0}: Error finding container d3639a4e33befe4f3f673a824f61dcb42c7c73aae3b9148fd7ce40cbd2734419: Status 404 returned error can't find the container with id d3639a4e33befe4f3f673a824f61dcb42c7c73aae3b9148fd7ce40cbd2734419
May 26 16:11:35.165869 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:35.165768    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8tg9b" event={"ID":"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78","Type":"ContainerStarted","Data":"d3639a4e33befe4f3f673a824f61dcb42c7c73aae3b9148fd7ce40cbd2734419"}
May 26 16:11:36.169947 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:36.169921    2562 generic.go:358] "Generic (PLEG): container finished" podID="3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78" containerID="1ff0c93c8bbaa46e731aeee2da6dde9856f3903febffa5bcb2e3ed7a8d8a759a" exitCode=0
May 26 16:11:36.170244 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:36.169968    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8tg9b" event={"ID":"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78","Type":"ContainerDied","Data":"1ff0c93c8bbaa46e731aeee2da6dde9856f3903febffa5bcb2e3ed7a8d8a759a"}
May 26 16:11:37.174201 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:37.174168    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8tg9b" event={"ID":"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78","Type":"ContainerStarted","Data":"1384b6d33a6011a832e4e5b1e813fd5937a006b1ed05b8bd1034662c748b54d9"}
May 26 16:11:37.174201 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:37.174204    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8tg9b" event={"ID":"3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78","Type":"ContainerStarted","Data":"4070ca1c184abab150961e5c08583c5290c523e5d84d6148d83cd614536d4bc5"}
May 26 16:11:37.196414 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:37.196371    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8tg9b" podStartSLOduration=2.095971978 podStartE2EDuration="3.196357478s" podCreationTimestamp="2026-05-26 16:11:34 +0000 UTC" firstStartedPulling="2026-05-26 16:11:34.864964606 +0000 UTC m=+187.869188153" lastFinishedPulling="2026-05-26 16:11:35.965350117 +0000 UTC m=+188.969573653" observedRunningTime="2026-05-26 16:11:37.195918355 +0000 UTC m=+190.200141910" watchObservedRunningTime="2026-05-26 16:11:37.196357478 +0000 UTC m=+190.200581033"
May 26 16:11:38.486065 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:38.486033    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:41.237503 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:41.237468    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" podUID="f827e7b0-6a9a-472a-a770-7e4e3d6537a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 16:11:51.237066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:51.237026    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" podUID="f827e7b0-6a9a-472a-a770-7e4e3d6537a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 16:11:53.499536 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.499462    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerName="registry" containerID="cri-o://6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67" gracePeriod=30
May 26 16:11:53.735056 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.735034    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:53.833016 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.832980    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hlsj\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833185 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833068    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833185 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833095    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833185 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833147    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833185 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833172    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833440 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833200    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833440 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833302    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833440 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833344    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates\") pod \"e1abd347-a158-4ebd-bb07-3ad79deef17c\" (UID: \"e1abd347-a158-4ebd-bb07-3ad79deef17c\") "
May 26 16:11:53.833593 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833480    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:53.833652 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833614    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-trusted-ca\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.833888 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.833862    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:11:53.835895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.835867    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:11:53.835895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.835874    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:11:53.836034 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.835914    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj" (OuterVolumeSpecName: "kube-api-access-6hlsj") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "kube-api-access-6hlsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:11:53.836034 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.835970    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:11:53.836034 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.835992    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 16:11:53.842212 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.842189    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e1abd347-a158-4ebd-bb07-3ad79deef17c" (UID: "e1abd347-a158-4ebd-bb07-3ad79deef17c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:11:53.934756 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934717    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1abd347-a158-4ebd-bb07-3ad79deef17c-ca-trust-extracted\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934756 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934753    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-image-registry-private-configuration\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934756 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934766    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-tls\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934981 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934776    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1abd347-a158-4ebd-bb07-3ad79deef17c-installation-pull-secrets\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934981 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934787    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-bound-sa-token\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934981 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934796    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1abd347-a158-4ebd-bb07-3ad79deef17c-registry-certificates\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:53.934981 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:53.934804    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hlsj\" (UniqueName: \"kubernetes.io/projected/e1abd347-a158-4ebd-bb07-3ad79deef17c-kube-api-access-6hlsj\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:11:54.222401 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.222306    2562 generic.go:358] "Generic (PLEG): container finished" podID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerID="6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67" exitCode=0
May 26 16:11:54.222401 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.222366    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" event={"ID":"e1abd347-a158-4ebd-bb07-3ad79deef17c","Type":"ContainerDied","Data":"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"}
May 26 16:11:54.222401 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.222373    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb"
May 26 16:11:54.222401 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.222392    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c546467c6-2b5nb" event={"ID":"e1abd347-a158-4ebd-bb07-3ad79deef17c","Type":"ContainerDied","Data":"a9577fec5196c6eb82a4a8b1600d3064b7c84414c367d98125401bc0dd0fa14e"}
May 26 16:11:54.222708 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.222407    2562 scope.go:117] "RemoveContainer" containerID="6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"
May 26 16:11:54.230863 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.230811    2562 scope.go:117] "RemoveContainer" containerID="6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"
May 26 16:11:54.231105 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:11:54.231084    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67\": container with ID starting with 6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67 not found: ID does not exist" containerID="6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"
May 26 16:11:54.231165 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.231115    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67"} err="failed to get container status \"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67\": rpc error: code = NotFound desc = could not find container \"6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67\": container with ID starting with 6e37597e823f33a3a4a145f49546f6712f4cc90c9b17021ed3bcb6755d036f67 not found: ID does not exist"
May 26 16:11:54.243736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.243714    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:11:54.247302 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:54.247279    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c546467c6-2b5nb"]
May 26 16:11:55.526956 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:11:55.526927    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" path="/var/lib/kubelet/pods/e1abd347-a158-4ebd-bb07-3ad79deef17c/volumes"
May 26 16:12:01.237569 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:01.237530    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" podUID="f827e7b0-6a9a-472a-a770-7e4e3d6537a0" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 16:12:01.238050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:01.237604    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr"
May 26 16:12:01.238223 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:01.238200    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"56efeebf20117396d7235ef63e6360a891136a082857522d200819cf7d49f540"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 16:12:01.238294 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:01.238250    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" podUID="f827e7b0-6a9a-472a-a770-7e4e3d6537a0" containerName="service-proxy" containerID="cri-o://56efeebf20117396d7235ef63e6360a891136a082857522d200819cf7d49f540" gracePeriod=30
May 26 16:12:02.244288 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:02.244253    2562 generic.go:358] "Generic (PLEG): container finished" podID="f827e7b0-6a9a-472a-a770-7e4e3d6537a0" containerID="56efeebf20117396d7235ef63e6360a891136a082857522d200819cf7d49f540" exitCode=2
May 26 16:12:02.244629 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:02.244317    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerDied","Data":"56efeebf20117396d7235ef63e6360a891136a082857522d200819cf7d49f540"}
May 26 16:12:02.244629 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:02.244349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c87b96cb4-b6ftr" event={"ID":"f827e7b0-6a9a-472a-a770-7e4e3d6537a0","Type":"ContainerStarted","Data":"5b76e89b36897c2add85ad8844d6815dbad3a5df008be2ac13035713f1f81904"}
May 26 16:12:39.275995 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:39.275942    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:12:39.278221 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:39.278201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/701d28a7-dc07-49e0-9e8a-60a836437170-metrics-certs\") pod \"network-metrics-daemon-v7p2l\" (UID: \"701d28a7-dc07-49e0-9e8a-60a836437170\") " pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:12:39.527222 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:39.527137    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4s662\""
May 26 16:12:39.535048 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:39.535030    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7p2l"
May 26 16:12:39.658429 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:39.658396    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7p2l"]
May 26 16:12:39.662153 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:12:39.662125    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod701d28a7_dc07_49e0_9e8a_60a836437170.slice/crio-5451278c6e3c8f6d9c10ed6334c49d2cc9f72be8f5b953e128b3328e2ea18ce5 WatchSource:0}: Error finding container 5451278c6e3c8f6d9c10ed6334c49d2cc9f72be8f5b953e128b3328e2ea18ce5: Status 404 returned error can't find the container with id 5451278c6e3c8f6d9c10ed6334c49d2cc9f72be8f5b953e128b3328e2ea18ce5
May 26 16:12:40.338451 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:40.338410    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7p2l" event={"ID":"701d28a7-dc07-49e0-9e8a-60a836437170","Type":"ContainerStarted","Data":"5451278c6e3c8f6d9c10ed6334c49d2cc9f72be8f5b953e128b3328e2ea18ce5"}
May 26 16:12:41.342918 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:41.342866    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7p2l" event={"ID":"701d28a7-dc07-49e0-9e8a-60a836437170","Type":"ContainerStarted","Data":"6770bc4f66cadf9797eb51e65b030916502da1a9a10e69b45400d9e9d6db9831"}
May 26 16:12:41.342918 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:41.342911    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7p2l" event={"ID":"701d28a7-dc07-49e0-9e8a-60a836437170","Type":"ContainerStarted","Data":"c0034f93f476f50128615e8073cc161a476ae2df7ab940b3353ea0d9facce2fe"}
May 26 16:12:41.360459 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:12:41.360414    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v7p2l" podStartSLOduration=253.130953728 podStartE2EDuration="4m14.360400446s" podCreationTimestamp="2026-05-26 16:08:27 +0000 UTC" firstStartedPulling="2026-05-26 16:12:39.664001512 +0000 UTC m=+252.668225050" lastFinishedPulling="2026-05-26 16:12:40.893448231 +0000 UTC m=+253.897671768" observedRunningTime="2026-05-26 16:12:41.359156949 +0000 UTC m=+254.363380499" watchObservedRunningTime="2026-05-26 16:12:41.360400446 +0000 UTC m=+254.364624000"
May 26 16:13:27.412195 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:13:27.412166    2562 kubelet.go:1628] "Image garbage collection succeeded"
May 26 16:14:52.520896 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.520863    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5g2h7"]
May 26 16:14:52.521372 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.521076    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerName="registry"
May 26 16:14:52.521372 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.521087    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerName="registry"
May 26 16:14:52.521372 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.521136    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1abd347-a158-4ebd-bb07-3ad79deef17c" containerName="registry"
May 26 16:14:52.524018 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.523996    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.526422 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.526404    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 26 16:14:52.526591 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.526573    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 26 16:14:52.526632 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.526601    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-s65hw\""
May 26 16:14:52.531812 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.531790    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5g2h7"]
May 26 16:14:52.648285 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.648244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-bound-sa-token\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.648451 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.648324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8sg5\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-kube-api-access-z8sg5\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.748793 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.748749    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-bound-sa-token\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.748979 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.748808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8sg5\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-kube-api-access-z8sg5\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.757279 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.757250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-bound-sa-token\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.757279 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.757274    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8sg5\" (UniqueName: \"kubernetes.io/projected/bf2bdb80-9465-40c1-97bd-7da10f753bc7-kube-api-access-z8sg5\") pod \"cert-manager-79c8d999ff-5g2h7\" (UID: \"bf2bdb80-9465-40c1-97bd-7da10f753bc7\") " pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.832517 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.832476    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-5g2h7"
May 26 16:14:52.949892 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.949849    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-5g2h7"]
May 26 16:14:52.953173 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:14:52.953148    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf2bdb80_9465_40c1_97bd_7da10f753bc7.slice/crio-90240b460453b4809d4f98df26c39a6fe57b6738f21c42952854f6ea5f019ccb WatchSource:0}: Error finding container 90240b460453b4809d4f98df26c39a6fe57b6738f21c42952854f6ea5f019ccb: Status 404 returned error can't find the container with id 90240b460453b4809d4f98df26c39a6fe57b6738f21c42952854f6ea5f019ccb
May 26 16:14:52.954988 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:52.954970    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:14:53.666632 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:53.666588    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5g2h7" event={"ID":"bf2bdb80-9465-40c1-97bd-7da10f753bc7","Type":"ContainerStarted","Data":"90240b460453b4809d4f98df26c39a6fe57b6738f21c42952854f6ea5f019ccb"}
May 26 16:14:57.678695 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:57.678652    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-5g2h7" event={"ID":"bf2bdb80-9465-40c1-97bd-7da10f753bc7","Type":"ContainerStarted","Data":"7e091869ed2ace1d2f8117833d9962591c3d85775f83198b80d09343f588ae52"}
May 26 16:14:57.695744 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:14:57.695693    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-5g2h7" podStartSLOduration=1.9707134499999999 podStartE2EDuration="5.69568061s" podCreationTimestamp="2026-05-26 16:14:52 +0000 UTC" firstStartedPulling="2026-05-26 16:14:52.955137015 +0000 UTC m=+385.959360548" lastFinishedPulling="2026-05-26 16:14:56.680104161 +0000 UTC m=+389.684327708" observedRunningTime="2026-05-26 16:14:57.694964849 +0000 UTC m=+390.699188405" watchObservedRunningTime="2026-05-26 16:14:57.69568061 +0000 UTC m=+390.699904164"
May 26 16:15:06.190051 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.190015    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"]
May 26 16:15:06.193112 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.193096    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.196003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.195972    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 16:15:06.196106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.196027    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 16:15:06.196106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.196057    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 16:15:06.196106 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.196031    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4wsd7\""
May 26 16:15:06.196531 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.196516    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 16:15:06.206944 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.206867    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"]
May 26 16:15:06.338749 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.338711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.338749 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.338749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.338951 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.338775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs5p4\" (UniqueName: \"kubernetes.io/projected/a385ee42-d500-441c-a0ad-57a5df03c66b-kube-api-access-qs5p4\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.439881 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.439846    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.439881 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.439882    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.440123 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.439899    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs5p4\" (UniqueName: \"kubernetes.io/projected/a385ee42-d500-441c-a0ad-57a5df03c66b-kube-api-access-qs5p4\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.442252 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.442226    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-webhook-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.442365 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.442302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a385ee42-d500-441c-a0ad-57a5df03c66b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.450632 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.450608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs5p4\" (UniqueName: \"kubernetes.io/projected/a385ee42-d500-441c-a0ad-57a5df03c66b-kube-api-access-qs5p4\") pod \"opendatahub-operator-controller-manager-74889b64d-ltqmb\" (UID: \"a385ee42-d500-441c-a0ad-57a5df03c66b\") " pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.503150 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.503119    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:06.631189 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.631153    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"]
May 26 16:15:06.634328 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:15:06.634302    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda385ee42_d500_441c_a0ad_57a5df03c66b.slice/crio-2ca89894f7f7c10dc0d4d1f032d2221e503578a485f1e5e5318acf404a7d73d0 WatchSource:0}: Error finding container 2ca89894f7f7c10dc0d4d1f032d2221e503578a485f1e5e5318acf404a7d73d0: Status 404 returned error can't find the container with id 2ca89894f7f7c10dc0d4d1f032d2221e503578a485f1e5e5318acf404a7d73d0
May 26 16:15:06.702284 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:06.702203    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb" event={"ID":"a385ee42-d500-441c-a0ad-57a5df03c66b","Type":"ContainerStarted","Data":"2ca89894f7f7c10dc0d4d1f032d2221e503578a485f1e5e5318acf404a7d73d0"}
May 26 16:15:09.712029 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:09.711939    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb" event={"ID":"a385ee42-d500-441c-a0ad-57a5df03c66b","Type":"ContainerStarted","Data":"d8a5583c9a2fee323f07ed977a7192de7ba247fc827ac6832a5017f6b56bf7e0"}
May 26 16:15:09.712029 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:09.711989    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:09.732782 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:09.732731    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb" podStartSLOduration=1.081905956 podStartE2EDuration="3.73271336s" podCreationTimestamp="2026-05-26 16:15:06 +0000 UTC" firstStartedPulling="2026-05-26 16:15:06.635977266 +0000 UTC m=+399.640200800" lastFinishedPulling="2026-05-26 16:15:09.286784663 +0000 UTC m=+402.291008204" observedRunningTime="2026-05-26 16:15:09.730697417 +0000 UTC m=+402.734920972" watchObservedRunningTime="2026-05-26 16:15:09.73271336 +0000 UTC m=+402.736936915"
May 26 16:15:20.716647 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:20.716611    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74889b64d-ltqmb"
May 26 16:15:27.693555 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.693519    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2vcjg"]
May 26 16:15:27.696640 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.696624    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:27.699047 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.699027    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 26 16:15:27.699047 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.699031    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-wvknr\""
May 26 16:15:27.706680 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.706654    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2vcjg"]
May 26 16:15:27.797127 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.797096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:27.797276 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.797131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgm8z\" (UniqueName: \"kubernetes.io/projected/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-kube-api-access-sgm8z\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:27.897849 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.897802    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:27.898005 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.897857    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgm8z\" (UniqueName: \"kubernetes.io/projected/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-kube-api-access-sgm8z\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:27.898005 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:27.897948    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 26 16:15:27.898086 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:27.898009    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert podName:fb3e25da-1dfe-4188-bb5c-268142b3d4fd nodeName:}" failed. No retries permitted until 2026-05-26 16:15:28.397992628 +0000 UTC m=+421.402216180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert") pod "odh-model-controller-858dbf95b8-2vcjg" (UID: "fb3e25da-1dfe-4188-bb5c-268142b3d4fd") : secret "odh-model-controller-webhook-cert" not found
May 26 16:15:27.906470 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:27.906448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgm8z\" (UniqueName: \"kubernetes.io/projected/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-kube-api-access-sgm8z\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:28.401165 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:28.401131    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:28.403476 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:28.403448    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb3e25da-1dfe-4188-bb5c-268142b3d4fd-cert\") pod \"odh-model-controller-858dbf95b8-2vcjg\" (UID: \"fb3e25da-1dfe-4188-bb5c-268142b3d4fd\") " pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:28.606753 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:28.606697    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:28.730520 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:28.730482    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-2vcjg"]
May 26 16:15:28.734562 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:15:28.734525    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb3e25da_1dfe_4188_bb5c_268142b3d4fd.slice/crio-22cffb84f6cafc4f79885b723cc1aecdc8830b0bceaaa891b21470d249ecae4f WatchSource:0}: Error finding container 22cffb84f6cafc4f79885b723cc1aecdc8830b0bceaaa891b21470d249ecae4f: Status 404 returned error can't find the container with id 22cffb84f6cafc4f79885b723cc1aecdc8830b0bceaaa891b21470d249ecae4f
May 26 16:15:28.762258 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:28.762235    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" event={"ID":"fb3e25da-1dfe-4188-bb5c-268142b3d4fd","Type":"ContainerStarted","Data":"22cffb84f6cafc4f79885b723cc1aecdc8830b0bceaaa891b21470d249ecae4f"}
May 26 16:15:31.772389 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:31.772292    2562 generic.go:358] "Generic (PLEG): container finished" podID="fb3e25da-1dfe-4188-bb5c-268142b3d4fd" containerID="d78ec6b764c4349f8408569d1b0e00067111abe8a0653cc6aa62cb6680130400" exitCode=1
May 26 16:15:31.772389 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:31.772371    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" event={"ID":"fb3e25da-1dfe-4188-bb5c-268142b3d4fd","Type":"ContainerDied","Data":"d78ec6b764c4349f8408569d1b0e00067111abe8a0653cc6aa62cb6680130400"}
May 26 16:15:31.772920 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:31.772631    2562 scope.go:117] "RemoveContainer" containerID="d78ec6b764c4349f8408569d1b0e00067111abe8a0653cc6aa62cb6680130400"
May 26 16:15:32.695192 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.695157    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rkvqp"]
May 26 16:15:32.697071 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.697054    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.699508 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.699489    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 26 16:15:32.699611 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.699594    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-7jqhw\""
May 26 16:15:32.707183 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.707162    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rkvqp"]
May 26 16:15:32.777104 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.777077    2562 generic.go:358] "Generic (PLEG): container finished" podID="fb3e25da-1dfe-4188-bb5c-268142b3d4fd" containerID="6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2" exitCode=1
May 26 16:15:32.777483 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.777149    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" event={"ID":"fb3e25da-1dfe-4188-bb5c-268142b3d4fd","Type":"ContainerDied","Data":"6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2"}
May 26 16:15:32.777483 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.777179    2562 scope.go:117] "RemoveContainer" containerID="d78ec6b764c4349f8408569d1b0e00067111abe8a0653cc6aa62cb6680130400"
May 26 16:15:32.777483 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.777362    2562 scope.go:117] "RemoveContainer" containerID="6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2"
May 26 16:15:32.777596 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:32.777575    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2vcjg_opendatahub(fb3e25da-1dfe-4188-bb5c-268142b3d4fd)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" podUID="fb3e25da-1dfe-4188-bb5c-268142b3d4fd"
May 26 16:15:32.835656 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.835624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v74vk\" (UniqueName: \"kubernetes.io/projected/11d19be1-ed8f-40b1-92d3-104cb7a58100-kube-api-access-v74vk\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.835769 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.835682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11d19be1-ed8f-40b1-92d3-104cb7a58100-cert\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.936499 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.936473    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11d19be1-ed8f-40b1-92d3-104cb7a58100-cert\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.936671 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.936567    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v74vk\" (UniqueName: \"kubernetes.io/projected/11d19be1-ed8f-40b1-92d3-104cb7a58100-kube-api-access-v74vk\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.938902 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.938883    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/11d19be1-ed8f-40b1-92d3-104cb7a58100-cert\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:32.944617 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:32.944595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v74vk\" (UniqueName: \"kubernetes.io/projected/11d19be1-ed8f-40b1-92d3-104cb7a58100-kube-api-access-v74vk\") pod \"kserve-controller-manager-856948b99f-rkvqp\" (UID: \"11d19be1-ed8f-40b1-92d3-104cb7a58100\") " pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:33.006841 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:33.006768    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:33.131235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:33.131197    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-rkvqp"]
May 26 16:15:33.134415 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:15:33.134384    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11d19be1_ed8f_40b1_92d3_104cb7a58100.slice/crio-ed0bed02fef4a9feda515c0fc5cc8f662115a98b7b125483f8448f900d565293 WatchSource:0}: Error finding container ed0bed02fef4a9feda515c0fc5cc8f662115a98b7b125483f8448f900d565293: Status 404 returned error can't find the container with id ed0bed02fef4a9feda515c0fc5cc8f662115a98b7b125483f8448f900d565293
May 26 16:15:33.780420 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:33.780388    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp" event={"ID":"11d19be1-ed8f-40b1-92d3-104cb7a58100","Type":"ContainerStarted","Data":"ed0bed02fef4a9feda515c0fc5cc8f662115a98b7b125483f8448f900d565293"}
May 26 16:15:33.782052 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:33.782028    2562 scope.go:117] "RemoveContainer" containerID="6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2"
May 26 16:15:33.782227 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:33.782210    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2vcjg_opendatahub(fb3e25da-1dfe-4188-bb5c-268142b3d4fd)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" podUID="fb3e25da-1dfe-4188-bb5c-268142b3d4fd"
May 26 16:15:35.441651 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.441618    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"]
May 26 16:15:35.443647 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.443629    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.447904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.447881    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 26 16:15:35.448009 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.447964    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vqfss\""
May 26 16:15:35.448733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.448712    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 16:15:35.448994 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.448977    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 26 16:15:35.449056 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.449042    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 16:15:35.459641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.459622    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"]
May 26 16:15:35.555606 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.555577    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bbrv\" (UniqueName: \"kubernetes.io/projected/1d9c0861-3a9f-472d-899d-571a54420281-kube-api-access-6bbrv\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.555740 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.555611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9c0861-3a9f-472d-899d-571a54420281-tmp\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.555740 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.555640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.656491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.656461    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bbrv\" (UniqueName: \"kubernetes.io/projected/1d9c0861-3a9f-472d-899d-571a54420281-kube-api-access-6bbrv\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.656491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.656491    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9c0861-3a9f-472d-899d-571a54420281-tmp\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.656688 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.656523    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.656688 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:35.656620    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 26 16:15:35.656688 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:35.656683    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs podName:1d9c0861-3a9f-472d-899d-571a54420281 nodeName:}" failed. No retries permitted until 2026-05-26 16:15:36.156663492 +0000 UTC m=+429.160887037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs") pod "kube-auth-proxy-78464866b8-mfdwr" (UID: "1d9c0861-3a9f-472d-899d-571a54420281") : secret "kube-auth-proxy-tls" not found
May 26 16:15:35.658727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.658696    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1d9c0861-3a9f-472d-899d-571a54420281-tmp\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:35.665567 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:35.665547    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bbrv\" (UniqueName: \"kubernetes.io/projected/1d9c0861-3a9f-472d-899d-571a54420281-kube-api-access-6bbrv\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:36.159491 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:36.159454    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:36.161793 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:36.161765    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d9c0861-3a9f-472d-899d-571a54420281-tls-certs\") pod \"kube-auth-proxy-78464866b8-mfdwr\" (UID: \"1d9c0861-3a9f-472d-899d-571a54420281\") " pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:36.353727 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:36.353693    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"
May 26 16:15:36.870066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:36.870039    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-78464866b8-mfdwr"]
May 26 16:15:36.872316 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:15:36.872287    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9c0861_3a9f_472d_899d_571a54420281.slice/crio-e7ab44a58a951575d6a834c9ddd6032fcd60a8787dd9937b739d5c3652039e3f WatchSource:0}: Error finding container e7ab44a58a951575d6a834c9ddd6032fcd60a8787dd9937b739d5c3652039e3f: Status 404 returned error can't find the container with id e7ab44a58a951575d6a834c9ddd6032fcd60a8787dd9937b739d5c3652039e3f
May 26 16:15:37.797374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:37.797318    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp" event={"ID":"11d19be1-ed8f-40b1-92d3-104cb7a58100","Type":"ContainerStarted","Data":"1baa16517f6f0069ecbc316602a4b6413d733eaaa116c659f04219a9af5f37cf"}
May 26 16:15:37.797572 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:37.797455    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:15:37.798384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:37.798358    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr" event={"ID":"1d9c0861-3a9f-472d-899d-571a54420281","Type":"ContainerStarted","Data":"e7ab44a58a951575d6a834c9ddd6032fcd60a8787dd9937b739d5c3652039e3f"}
May 26 16:15:37.816321 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:37.816271    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp" podStartSLOduration=2.176855669 podStartE2EDuration="5.8162579s" podCreationTimestamp="2026-05-26 16:15:32 +0000 UTC" firstStartedPulling="2026-05-26 16:15:33.136187636 +0000 UTC m=+426.140411169" lastFinishedPulling="2026-05-26 16:15:36.775589848 +0000 UTC m=+429.779813400" observedRunningTime="2026-05-26 16:15:37.815141951 +0000 UTC m=+430.819365497" watchObservedRunningTime="2026-05-26 16:15:37.8162579 +0000 UTC m=+430.820481454"
May 26 16:15:38.607455 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:38.607419    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:38.607894 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:38.607841    2562 scope.go:117] "RemoveContainer" containerID="6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2"
May 26 16:15:38.608051 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:15:38.608032    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-2vcjg_opendatahub(fb3e25da-1dfe-4188-bb5c-268142b3d4fd)\"" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" podUID="fb3e25da-1dfe-4188-bb5c-268142b3d4fd"
May 26 16:15:39.805979 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:39.805942    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr" event={"ID":"1d9c0861-3a9f-472d-899d-571a54420281","Type":"ContainerStarted","Data":"8dee2e8e14e7fcdd60f681e48659da1586713958424c610435a8d87ab902d75c"}
May 26 16:15:39.821904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:39.821850    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-78464866b8-mfdwr" podStartSLOduration=2.001407441 podStartE2EDuration="4.821835472s" podCreationTimestamp="2026-05-26 16:15:35 +0000 UTC" firstStartedPulling="2026-05-26 16:15:36.874001304 +0000 UTC m=+429.878224836" lastFinishedPulling="2026-05-26 16:15:39.694429331 +0000 UTC m=+432.698652867" observedRunningTime="2026-05-26 16:15:39.820968403 +0000 UTC m=+432.825191958" watchObservedRunningTime="2026-05-26 16:15:39.821835472 +0000 UTC m=+432.826059020"
May 26 16:15:48.607596 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:48.607519    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:48.607975 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:48.607916    2562 scope.go:117] "RemoveContainer" containerID="6d53ad7d9ef49b8936832c9573c91223ef886ab4655e51726afb86580ca333f2"
May 26 16:15:49.837192 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:49.837161    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" event={"ID":"fb3e25da-1dfe-4188-bb5c-268142b3d4fd","Type":"ContainerStarted","Data":"0ab09e8f891ced442f655442b5d9bf2937a56a72a022c1a4386891950d7e4ff3"}
May 26 16:15:49.837641 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:49.837365    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:15:49.872180 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:49.872131    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg" podStartSLOduration=2.681483523 podStartE2EDuration="22.872116177s" podCreationTimestamp="2026-05-26 16:15:27 +0000 UTC" firstStartedPulling="2026-05-26 16:15:28.735781629 +0000 UTC m=+421.740005166" lastFinishedPulling="2026-05-26 16:15:48.92641426 +0000 UTC m=+441.930637820" observedRunningTime="2026-05-26 16:15:49.87125491 +0000 UTC m=+442.875478464" watchObservedRunningTime="2026-05-26 16:15:49.872116177 +0000 UTC m=+442.876339731"
May 26 16:15:50.925402 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.925373    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"]
May 26 16:15:50.928706 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.928686    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:50.932911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.931949    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-59mnn\""
May 26 16:15:50.932911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.932006    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 26 16:15:50.932911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.931954    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 26 16:15:50.940579 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.940539    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"]
May 26 16:15:50.967046 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.967012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4qf\" (UniqueName: \"kubernetes.io/projected/217c50b9-4a47-4512-8ded-462d5f5475b8-kube-api-access-ks4qf\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:50.967202 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:50.967071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/217c50b9-4a47-4512-8ded-462d5f5475b8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.068232 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.068198    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/217c50b9-4a47-4512-8ded-462d5f5475b8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.068409 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.068255    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4qf\" (UniqueName: \"kubernetes.io/projected/217c50b9-4a47-4512-8ded-462d5f5475b8-kube-api-access-ks4qf\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.070646 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.070627    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/217c50b9-4a47-4512-8ded-462d5f5475b8-operator-config\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.080399 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.080369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4qf\" (UniqueName: \"kubernetes.io/projected/217c50b9-4a47-4512-8ded-462d5f5475b8-kube-api-access-ks4qf\") pod \"servicemesh-operator3-55f49c5f94-btm7s\" (UID: \"217c50b9-4a47-4512-8ded-462d5f5475b8\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.241110 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.241042    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:51.373895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.373864    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"]
May 26 16:15:51.376763 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:15:51.376734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217c50b9_4a47_4512_8ded_462d5f5475b8.slice/crio-32d731da53537b6b0ca4ef9da989d80580885abe78c6b611a9ca69a40e5b0b14 WatchSource:0}: Error finding container 32d731da53537b6b0ca4ef9da989d80580885abe78c6b611a9ca69a40e5b0b14: Status 404 returned error can't find the container with id 32d731da53537b6b0ca4ef9da989d80580885abe78c6b611a9ca69a40e5b0b14
May 26 16:15:51.844584 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:51.844548    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s" event={"ID":"217c50b9-4a47-4512-8ded-462d5f5475b8","Type":"ContainerStarted","Data":"32d731da53537b6b0ca4ef9da989d80580885abe78c6b611a9ca69a40e5b0b14"}
May 26 16:15:54.855254 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:54.855217    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s" event={"ID":"217c50b9-4a47-4512-8ded-462d5f5475b8","Type":"ContainerStarted","Data":"1e5fb8c5d738770a4a3afbbe695b8563fa8fe7195e36a340ca796bbaaedbfb5f"}
May 26 16:15:54.855709 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:54.855331    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:15:54.894325 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:15:54.894270    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s" podStartSLOduration=2.214736215 podStartE2EDuration="4.894255761s" podCreationTimestamp="2026-05-26 16:15:50 +0000 UTC" firstStartedPulling="2026-05-26 16:15:51.379150692 +0000 UTC m=+444.383374225" lastFinishedPulling="2026-05-26 16:15:54.058670228 +0000 UTC m=+447.062893771" observedRunningTime="2026-05-26 16:15:54.893305199 +0000 UTC m=+447.897528754" watchObservedRunningTime="2026-05-26 16:15:54.894255761 +0000 UTC m=+447.898479315"
May 26 16:16:00.842272 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:00.842238    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-2vcjg"
May 26 16:16:05.860450 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:05.860415    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-btm7s"
May 26 16:16:07.124159 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.124130    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"]
May 26 16:16:07.128229 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.128205    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.130832 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.130800    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 26 16:16:07.130977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.130845    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 26 16:16:07.130977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.130920    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 26 16:16:07.130977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.130957    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c6dvs\""
May 26 16:16:07.131127 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.131015    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 16:16:07.147734 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.147712    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"]
May 26 16:16:07.195633 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195795 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphxf\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-kube-api-access-kphxf\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195795 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195680    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195795 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195945 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036abf9b-0c7d-43a0-b981-10f28a19d01e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195945 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.195945 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.195890    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.296848 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.296800    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.296848 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.296854    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036abf9b-0c7d-43a0-b981-10f28a19d01e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297081 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.296961    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297081 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.297003    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297081 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.297029    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297081 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.297053    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kphxf\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-kube-api-access-kphxf\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297286 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.297090    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.297672 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.297645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.299262 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.299233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/036abf9b-0c7d-43a0-b981-10f28a19d01e-local-certs\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.299421 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.299403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-cacerts\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.299585 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.299567    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.299720 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.299704    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.313897 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.313872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphxf\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-kube-api-access-kphxf\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.314627 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.314610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/036abf9b-0c7d-43a0-b981-10f28a19d01e-istio-token\") pod \"istiod-openshift-gateway-798958bb55-krlmj\" (UID: \"036abf9b-0c7d-43a0-b981-10f28a19d01e\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.437559 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.437476    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:07.608346 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.608312    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"]
May 26 16:16:07.893501 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:07.893462    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj" event={"ID":"036abf9b-0c7d-43a0-b981-10f28a19d01e","Type":"ContainerStarted","Data":"c4266c84557822692828347cdc6176db73327ed0a39940f527490f9a0c83124f"}
May 26 16:16:08.808470 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:08.808438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-rkvqp"
May 26 16:16:10.205150 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:10.205116    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 16:16:10.205416 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:10.205181    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 16:16:10.907236 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:10.907197    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj" event={"ID":"036abf9b-0c7d-43a0-b981-10f28a19d01e","Type":"ContainerStarted","Data":"1b459e4769e51c31d465fdf37973a18d0ad58d3d7540dfd9cb3781728bec2637"}
May 26 16:16:10.907493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:10.907467    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:16:10.929864 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:10.929786    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj" podStartSLOduration=1.33919545 podStartE2EDuration="3.92976804s" podCreationTimestamp="2026-05-26 16:16:07 +0000 UTC" firstStartedPulling="2026-05-26 16:16:07.614338197 +0000 UTC m=+460.618561745" lastFinishedPulling="2026-05-26 16:16:10.2049108 +0000 UTC m=+463.209134335" observedRunningTime="2026-05-26 16:16:10.92754172 +0000 UTC m=+463.931765302" watchObservedRunningTime="2026-05-26 16:16:10.92976804 +0000 UTC m=+463.933991596"
May 26 16:16:11.912505 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:16:11.912471    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-krlmj"
May 26 16:17:01.327162 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.327119    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"]
May 26 16:17:01.329797 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.329780    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:01.332394 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.332362    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 26 16:17:01.332505 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.332400    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n855r\""
May 26 16:17:01.333439 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.333412    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 16:17:01.333527 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.333448    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 16:17:01.348258 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.348233    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"]
May 26 16:17:01.407512 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.407480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pc8\" (UniqueName: \"kubernetes.io/projected/60979a14-4d2e-4e42-a506-23d1d89864b8-kube-api-access-68pc8\") pod \"dns-operator-controller-manager-648d5c98bc-5vdjc\" (UID: \"60979a14-4d2e-4e42-a506-23d1d89864b8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:01.508540 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.508504    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68pc8\" (UniqueName: \"kubernetes.io/projected/60979a14-4d2e-4e42-a506-23d1d89864b8-kube-api-access-68pc8\") pod \"dns-operator-controller-manager-648d5c98bc-5vdjc\" (UID: \"60979a14-4d2e-4e42-a506-23d1d89864b8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:01.527502 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.527474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pc8\" (UniqueName: \"kubernetes.io/projected/60979a14-4d2e-4e42-a506-23d1d89864b8-kube-api-access-68pc8\") pod \"dns-operator-controller-manager-648d5c98bc-5vdjc\" (UID: \"60979a14-4d2e-4e42-a506-23d1d89864b8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:01.639224 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.639127    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:01.767736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:01.767702    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"]
May 26 16:17:01.770895 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:01.770867    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60979a14_4d2e_4e42_a506_23d1d89864b8.slice/crio-95e5269b3e38134b27722f4bca7f5dd64d5448117467841cac8adebd2f04ee65 WatchSource:0}: Error finding container 95e5269b3e38134b27722f4bca7f5dd64d5448117467841cac8adebd2f04ee65: Status 404 returned error can't find the container with id 95e5269b3e38134b27722f4bca7f5dd64d5448117467841cac8adebd2f04ee65
May 26 16:17:02.060504 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:02.060474    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc" event={"ID":"60979a14-4d2e-4e42-a506-23d1d89864b8","Type":"ContainerStarted","Data":"95e5269b3e38134b27722f4bca7f5dd64d5448117467841cac8adebd2f04ee65"}
May 26 16:17:05.077324 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.077283    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc" event={"ID":"60979a14-4d2e-4e42-a506-23d1d89864b8","Type":"ContainerStarted","Data":"ceb0a5ea9f681c103da8936d8500f45fa68647771cebd7f3df77269f6c5cbb92"}
May 26 16:17:05.077723 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.077415    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:05.102497 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.102445    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc" podStartSLOduration=0.977534325 podStartE2EDuration="4.102433298s" podCreationTimestamp="2026-05-26 16:17:01 +0000 UTC" firstStartedPulling="2026-05-26 16:17:01.772673041 +0000 UTC m=+514.776896575" lastFinishedPulling="2026-05-26 16:17:04.897572015 +0000 UTC m=+517.901795548" observedRunningTime="2026-05-26 16:17:05.101501146 +0000 UTC m=+518.105724702" watchObservedRunningTime="2026-05-26 16:17:05.102433298 +0000 UTC m=+518.106656852"
May 26 16:17:05.927520 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.927482    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"]
May 26 16:17:05.931011 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.930989    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:05.933640 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.933618    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nz4hn\""
May 26 16:17:05.946023 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:05.946000    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"]
May 26 16:17:06.043596 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.043567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.043763 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.043605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8f87\" (UniqueName: \"kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.144895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.144862    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.144895 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.144900    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v8f87\" (UniqueName: \"kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.145390 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.145315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.157967 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.157940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8f87\" (UniqueName: \"kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.240376 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.240299    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:06.369690 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:06.369655    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"]
May 26 16:17:06.373549 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:06.373518    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9491443a_88b5_49d0_89a6_18df43c4fb0f.slice/crio-b5cdae8e974f23fa9bfa50000fcbf7d91f134c996a273775d77e5e316ceb8f76 WatchSource:0}: Error finding container b5cdae8e974f23fa9bfa50000fcbf7d91f134c996a273775d77e5e316ceb8f76: Status 404 returned error can't find the container with id b5cdae8e974f23fa9bfa50000fcbf7d91f134c996a273775d77e5e316ceb8f76
May 26 16:17:07.087743 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:07.087708    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" event={"ID":"9491443a-88b5-49d0-89a6-18df43c4fb0f","Type":"ContainerStarted","Data":"b5cdae8e974f23fa9bfa50000fcbf7d91f134c996a273775d77e5e316ceb8f76"}
May 26 16:17:13.110082 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:13.110035    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" event={"ID":"9491443a-88b5-49d0-89a6-18df43c4fb0f","Type":"ContainerStarted","Data":"5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd"}
May 26 16:17:13.110497 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:13.110115    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:13.143063 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:13.143013    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" podStartSLOduration=2.210113547 podStartE2EDuration="8.142999028s" podCreationTimestamp="2026-05-26 16:17:05 +0000 UTC" firstStartedPulling="2026-05-26 16:17:06.37575684 +0000 UTC m=+519.379980374" lastFinishedPulling="2026-05-26 16:17:12.308642312 +0000 UTC m=+525.312865855" observedRunningTime="2026-05-26 16:17:13.140546495 +0000 UTC m=+526.144770051" watchObservedRunningTime="2026-05-26 16:17:13.142999028 +0000 UTC m=+526.147222582"
May 26 16:17:16.083462 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:16.083388    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-5vdjc"
May 26 16:17:24.115248 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:24.115216    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:25.367968 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.367924    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"]
May 26 16:17:25.371198 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.371175    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.386140 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.386117    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"]
May 26 16:17:25.498684 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.498652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.498880 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.498693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkn8x\" (UniqueName: \"kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.599574 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.599538    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.599574 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.599575    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rkn8x\" (UniqueName: \"kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.599945 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.599925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.609078 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.609055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkn8x\" (UniqueName: \"kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.681030 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.680953    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:25.813153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:25.813113    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"]
May 26 16:17:25.816150 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:25.816121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99608ca_bc45_4a09_98f1_0614257a7a2b.slice/crio-0d98dd17fc8d5cff0a6d599e681dbd849fa1a829f4807d96d565a0e8bdab6a5c WatchSource:0}: Error finding container 0d98dd17fc8d5cff0a6d599e681dbd849fa1a829f4807d96d565a0e8bdab6a5c: Status 404 returned error can't find the container with id 0d98dd17fc8d5cff0a6d599e681dbd849fa1a829f4807d96d565a0e8bdab6a5c
May 26 16:17:26.157064 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.157026    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" event={"ID":"e99608ca-bc45-4a09-98f1-0614257a7a2b","Type":"ContainerStarted","Data":"158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842"}
May 26 16:17:26.157064 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.157064    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" event={"ID":"e99608ca-bc45-4a09-98f1-0614257a7a2b","Type":"ContainerStarted","Data":"0d98dd17fc8d5cff0a6d599e681dbd849fa1a829f4807d96d565a0e8bdab6a5c"}
May 26 16:17:26.157295 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.157162    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:26.186698 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.186655    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" podStartSLOduration=1.1866414299999999 podStartE2EDuration="1.18664143s" podCreationTimestamp="2026-05-26 16:17:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:17:26.185324668 +0000 UTC m=+539.189548224" watchObservedRunningTime="2026-05-26 16:17:26.18664143 +0000 UTC m=+539.190864985"
May 26 16:17:26.776246 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.776207    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"]
May 26 16:17:26.776637 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.776433    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" containerName="manager" containerID="cri-o://5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd" gracePeriod=2
May 26 16:17:26.794252 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.794227    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"]
May 26 16:17:26.811365 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.811330    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"]
May 26 16:17:26.817045 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.816982    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"]
May 26 16:17:26.825786 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.825759    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:26.826140 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826121    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" containerName="manager"
May 26 16:17:26.826140 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826143    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" containerName="manager"
May 26 16:17:26.826374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826162    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" containerName="manager"
May 26 16:17:26.826374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826170    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" containerName="manager"
May 26 16:17:26.826374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826253    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" containerName="manager"
May 26 16:17:26.826374 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.826267    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" containerName="manager"
May 26 16:17:26.829475 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.829457    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:26.852950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.852902    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:26.875710 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.875676    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:26.886982 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.886946    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:26.890507 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.890480    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:26.909450 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.909420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:26.909593 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.909463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xcsg\" (UniqueName: \"kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:26.910289 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.910269    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:26.953952 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:26.953921    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.009615 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.009592    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:27.009779 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.009760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.009853 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.009800    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:27.009962 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.009940    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7xcsg\" (UniqueName: \"kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:27.010021 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.010005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clhtg\" (UniqueName: \"kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.010149 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.010136    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:27.012227 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.012205    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.019549 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.019526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xcsg\" (UniqueName: \"kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-vbfhh\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:27.110687 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.110596    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8f87\" (UniqueName: \"kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87\") pod \"9491443a-88b5-49d0-89a6-18df43c4fb0f\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") "
May 26 16:17:27.110687 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.110681    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume\") pod \"9491443a-88b5-49d0-89a6-18df43c4fb0f\" (UID: \"9491443a-88b5-49d0-89a6-18df43c4fb0f\") "
May 26 16:17:27.110941 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.110808    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.110941 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.110905    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clhtg\" (UniqueName: \"kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.111207 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.111185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.111306 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.111277    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9491443a-88b5-49d0-89a6-18df43c4fb0f" (UID: "9491443a-88b5-49d0-89a6-18df43c4fb0f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:17:27.112846 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.112809    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87" (OuterVolumeSpecName: "kube-api-access-v8f87") pod "9491443a-88b5-49d0-89a6-18df43c4fb0f" (UID: "9491443a-88b5-49d0-89a6-18df43c4fb0f"). InnerVolumeSpecName "kube-api-access-v8f87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:17:27.120043 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.120023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clhtg\" (UniqueName: \"kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.161340 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.161317    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:27.161592 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.161572    2562 generic.go:358] "Generic (PLEG): container finished" podID="9491443a-88b5-49d0-89a6-18df43c4fb0f" containerID="5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd" exitCode=0
May 26 16:17:27.161657 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.161619    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2"
May 26 16:17:27.161698 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.161667    2562 scope.go:117] "RemoveContainer" containerID="5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd"
May 26 16:17:27.162055 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:17:27.162026    2562 kuberuntime_manager.go:623] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" container="manager"
May 26 16:17:27.164003 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.163973    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.165963 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.165937    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.167950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.167925    2562 status_manager.go:895] "Failed to get status for pod" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.171047 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.171030    2562 scope.go:117] "RemoveContainer" containerID="5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd"
May 26 16:17:27.171418 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:17:27.171390    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd\": container with ID starting with 5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd not found: ID does not exist" containerID="5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd"
May 26 16:17:27.171476 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.171420    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd"} err="failed to get container status \"5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd\": rpc error: code = NotFound desc = could not find container \"5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd\": container with ID starting with 5708d2882c404c489f7b9fc72ca74b93f577ef8ffde9f98920d00fa04de1e2fd not found: ID does not exist"
May 26 16:17:27.172786 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.172763    2562 status_manager.go:895] "Failed to get status for pod" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.174732 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.174706    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.201912 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.201888    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:27.212018 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.211985    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8f87\" (UniqueName: \"kubernetes.io/projected/9491443a-88b5-49d0-89a6-18df43c4fb0f-kube-api-access-v8f87\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:27.212018 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.212018    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9491443a-88b5-49d0-89a6-18df43c4fb0f-extensions-socket-volume\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:27.308442 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.308385    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:27.312575 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:27.312543    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22f09b3_965e_4304_9a7e_09ca8e8520aa.slice/crio-428dbfa0e5041896e27616eba83e70e19e4fe901f4c3e1d419e7412e8aece5da WatchSource:0}: Error finding container 428dbfa0e5041896e27616eba83e70e19e4fe901f4c3e1d419e7412e8aece5da: Status 404 returned error can't find the container with id 428dbfa0e5041896e27616eba83e70e19e4fe901f4c3e1d419e7412e8aece5da
May 26 16:17:27.343891 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.343867    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:27.349851 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:27.349807    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81fbc29_c258_43c5_9121_32d1cb57bcc3.slice/crio-a58648420cc4bf4fc8a1cb6c1b9740103772f6710dd21fcf90abcb12c5a7f90b WatchSource:0}: Error finding container a58648420cc4bf4fc8a1cb6c1b9740103772f6710dd21fcf90abcb12c5a7f90b: Status 404 returned error can't find the container with id a58648420cc4bf4fc8a1cb6c1b9740103772f6710dd21fcf90abcb12c5a7f90b
May 26 16:17:27.529070 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.529037    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" path="/var/lib/kubelet/pods/9491443a-88b5-49d0-89a6-18df43c4fb0f/volumes"
May 26 16:17:27.551631 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.551592    2562 status_manager.go:895] "Failed to get status for pod" podUID="9491443a-88b5-49d0-89a6-18df43c4fb0f" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-7nkf2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-7nkf2\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:27.553543 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:27.553505    2562 status_manager.go:895] "Failed to get status for pod" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:28.166878 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.166841    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" containerName="manager" containerID="cri-o://158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842" gracePeriod=2
May 26 16:17:28.168208 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.168178    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" event={"ID":"e81fbc29-c258-43c5-9121-32d1cb57bcc3","Type":"ContainerStarted","Data":"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"}
May 26 16:17:28.168323 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.168214    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" event={"ID":"e81fbc29-c258-43c5-9121-32d1cb57bcc3","Type":"ContainerStarted","Data":"a58648420cc4bf4fc8a1cb6c1b9740103772f6710dd21fcf90abcb12c5a7f90b"}
May 26 16:17:28.168392 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.168364    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:28.169791 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.169767    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" event={"ID":"a22f09b3-965e-4304-9a7e-09ca8e8520aa","Type":"ContainerStarted","Data":"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"}
May 26 16:17:28.169889 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.169797    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" event={"ID":"a22f09b3-965e-4304-9a7e-09ca8e8520aa","Type":"ContainerStarted","Data":"428dbfa0e5041896e27616eba83e70e19e4fe901f4c3e1d419e7412e8aece5da"}
May 26 16:17:28.170010 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.169991    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:28.189265 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.189204    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" podStartSLOduration=2.189190016 podStartE2EDuration="2.189190016s" podCreationTimestamp="2026-05-26 16:17:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:17:28.188377858 +0000 UTC m=+541.192601451" watchObservedRunningTime="2026-05-26 16:17:28.189190016 +0000 UTC m=+541.193413573"
May 26 16:17:28.211188 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.211146    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" podStartSLOduration=2.211134022 podStartE2EDuration="2.211134022s" podCreationTimestamp="2026-05-26 16:17:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:17:28.21020198 +0000 UTC m=+541.214425535" watchObservedRunningTime="2026-05-26 16:17:28.211134022 +0000 UTC m=+541.215357577"
May 26 16:17:28.408806 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.408786    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:28.521744 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.521675    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume\") pod \"e99608ca-bc45-4a09-98f1-0614257a7a2b\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") "
May 26 16:17:28.521744 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.521712    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkn8x\" (UniqueName: \"kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x\") pod \"e99608ca-bc45-4a09-98f1-0614257a7a2b\" (UID: \"e99608ca-bc45-4a09-98f1-0614257a7a2b\") "
May 26 16:17:28.522066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.522046    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e99608ca-bc45-4a09-98f1-0614257a7a2b" (UID: "e99608ca-bc45-4a09-98f1-0614257a7a2b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:17:28.523708 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.523684    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x" (OuterVolumeSpecName: "kube-api-access-rkn8x") pod "e99608ca-bc45-4a09-98f1-0614257a7a2b" (UID: "e99608ca-bc45-4a09-98f1-0614257a7a2b"). InnerVolumeSpecName "kube-api-access-rkn8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:17:28.622950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.622925    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e99608ca-bc45-4a09-98f1-0614257a7a2b-extensions-socket-volume\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:28.622950 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:28.622948    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkn8x\" (UniqueName: \"kubernetes.io/projected/e99608ca-bc45-4a09-98f1-0614257a7a2b-kube-api-access-rkn8x\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:29.174422 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.174384    2562 generic.go:358] "Generic (PLEG): container finished" podID="e99608ca-bc45-4a09-98f1-0614257a7a2b" containerID="158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842" exitCode=0
May 26 16:17:29.174920 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.174431    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69"
May 26 16:17:29.174920 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.174483    2562 scope.go:117] "RemoveContainer" containerID="158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842"
May 26 16:17:29.176874 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.176850    2562 status_manager.go:895] "Failed to get status for pod" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:29.182566 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.182552    2562 scope.go:117] "RemoveContainer" containerID="158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842"
May 26 16:17:29.182802 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:17:29.182782    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842\": container with ID starting with 158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842 not found: ID does not exist" containerID="158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842"
May 26 16:17:29.182904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.182808    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842"} err="failed to get container status \"158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842\": rpc error: code = NotFound desc = could not find container \"158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842\": container with ID starting with 158cfde2f7f648309462d96969e04c10cf7dea99d36cee5019654ada95994842 not found: ID does not exist"
May 26 16:17:29.184586 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.184567    2562 status_manager.go:895] "Failed to get status for pod" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-v7q69" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-v7q69\" is forbidden: User \"system:node:ip-10-0-133-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-107.ec2.internal' and this object"
May 26 16:17:29.527639 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:29.527610    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99608ca-bc45-4a09-98f1-0614257a7a2b" path="/var/lib/kubelet/pods/e99608ca-bc45-4a09-98f1-0614257a7a2b/volumes"
May 26 16:17:39.176674 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.176644    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:39.177144 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.176694    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:39.275347 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.275306    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:39.275579 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.275554    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" podUID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" containerName="manager" containerID="cri-o://02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6" gracePeriod=10
May 26 16:17:39.534976 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.534947    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:39.586553 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.586524    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:17:39.586864 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.586850    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" containerName="manager"
May 26 16:17:39.586920 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.586865    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" containerName="manager"
May 26 16:17:39.586957 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.586928    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" containerName="manager"
May 26 16:17:39.602055 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.602026    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:17:39.602206 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.602182    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.708595 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.708568    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume\") pod \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") "
May 26 16:17:39.708711 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.708605    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xcsg\" (UniqueName: \"kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg\") pod \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\" (UID: \"a22f09b3-965e-4304-9a7e-09ca8e8520aa\") "
May 26 16:17:39.708711 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.708685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxrf\" (UniqueName: \"kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.708807 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.708737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.709017 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.708996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a22f09b3-965e-4304-9a7e-09ca8e8520aa" (UID: "a22f09b3-965e-4304-9a7e-09ca8e8520aa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:17:39.710615 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.710593    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg" (OuterVolumeSpecName: "kube-api-access-7xcsg") pod "a22f09b3-965e-4304-9a7e-09ca8e8520aa" (UID: "a22f09b3-965e-4304-9a7e-09ca8e8520aa"). InnerVolumeSpecName "kube-api-access-7xcsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:17:39.809683 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.809657    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.809790 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.809701    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxrf\" (UniqueName: \"kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.809790 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.809732    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a22f09b3-965e-4304-9a7e-09ca8e8520aa-extensions-socket-volume\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:39.809790 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.809742    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xcsg\" (UniqueName: \"kubernetes.io/projected/a22f09b3-965e-4304-9a7e-09ca8e8520aa-kube-api-access-7xcsg\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:39.810020 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.810003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.820066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.820038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxrf\" (UniqueName: \"kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf\") pod \"kuadrant-operator-controller-manager-55c7f4c975-t24sn\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:39.911743 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:39.911707    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:40.053864 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.053834    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:17:40.056699 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:40.056671    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b7b1b0_529e_4287_8875_2508cedf66d7.slice/crio-a2408e0af3cf95768699a6cecb357b383bd245cbfb1256ad81af05f56417d97d WatchSource:0}: Error finding container a2408e0af3cf95768699a6cecb357b383bd245cbfb1256ad81af05f56417d97d: Status 404 returned error can't find the container with id a2408e0af3cf95768699a6cecb357b383bd245cbfb1256ad81af05f56417d97d
May 26 16:17:40.213682 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.213641    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" event={"ID":"36b7b1b0-529e-4287-8875-2508cedf66d7","Type":"ContainerStarted","Data":"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"}
May 26 16:17:40.213682 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.213687    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" event={"ID":"36b7b1b0-529e-4287-8875-2508cedf66d7","Type":"ContainerStarted","Data":"a2408e0af3cf95768699a6cecb357b383bd245cbfb1256ad81af05f56417d97d"}
May 26 16:17:40.214163 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.213718    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:40.214875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.214847    2562 generic.go:358] "Generic (PLEG): container finished" podID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" containerID="02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6" exitCode=0
May 26 16:17:40.214989 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.214893    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" event={"ID":"a22f09b3-965e-4304-9a7e-09ca8e8520aa","Type":"ContainerDied","Data":"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"}
May 26 16:17:40.214989 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.214910    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh" event={"ID":"a22f09b3-965e-4304-9a7e-09ca8e8520aa","Type":"ContainerDied","Data":"428dbfa0e5041896e27616eba83e70e19e4fe901f4c3e1d419e7412e8aece5da"}
May 26 16:17:40.214989 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.214919    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"
May 26 16:17:40.215095 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.214924    2562 scope.go:117] "RemoveContainer" containerID="02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"
May 26 16:17:40.223163 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.223052    2562 scope.go:117] "RemoveContainer" containerID="02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"
May 26 16:17:40.223417 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:17:40.223389    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6\": container with ID starting with 02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6 not found: ID does not exist" containerID="02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"
May 26 16:17:40.223509 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.223423    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6"} err="failed to get container status \"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6\": rpc error: code = NotFound desc = could not find container \"02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6\": container with ID starting with 02a1efab6d552966d6b32cd2da504449e0ef8b84a86cbcb14c4334019bd060e6 not found: ID does not exist"
May 26 16:17:40.240797 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.240752    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" podStartSLOduration=1.240740553 podStartE2EDuration="1.240740553s" podCreationTimestamp="2026-05-26 16:17:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:17:40.239503108 +0000 UTC m=+553.243726662" watchObservedRunningTime="2026-05-26 16:17:40.240740553 +0000 UTC m=+553.244964108"
May 26 16:17:40.258851 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.258810    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:40.262708 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:40.262682    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-vbfhh"]
May 26 16:17:41.527743 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:41.527709    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a22f09b3-965e-4304-9a7e-09ca8e8520aa" path="/var/lib/kubelet/pods/a22f09b3-965e-4304-9a7e-09ca8e8520aa/volumes"
May 26 16:17:51.221660 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.221622    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:17:51.282240 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.282205    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:51.282687 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.282639    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" podUID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" containerName="manager" containerID="cri-o://fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e" gracePeriod=10
May 26 16:17:51.521741 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.521719    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:51.606169 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.606138    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume\") pod \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") "
May 26 16:17:51.606169 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.606169    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clhtg\" (UniqueName: \"kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg\") pod \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\" (UID: \"e81fbc29-c258-43c5-9121-32d1cb57bcc3\") "
May 26 16:17:51.606561 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.606528    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e81fbc29-c258-43c5-9121-32d1cb57bcc3" (UID: "e81fbc29-c258-43c5-9121-32d1cb57bcc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:17:51.608219 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.608193    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg" (OuterVolumeSpecName: "kube-api-access-clhtg") pod "e81fbc29-c258-43c5-9121-32d1cb57bcc3" (UID: "e81fbc29-c258-43c5-9121-32d1cb57bcc3"). InnerVolumeSpecName "kube-api-access-clhtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:17:51.707013 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.706980    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e81fbc29-c258-43c5-9121-32d1cb57bcc3-extensions-socket-volume\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:51.707013 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:51.707010    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clhtg\" (UniqueName: \"kubernetes.io/projected/e81fbc29-c258-43c5-9121-32d1cb57bcc3-kube-api-access-clhtg\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:17:52.258910 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.258870    2562 generic.go:358] "Generic (PLEG): container finished" podID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" containerID="fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e" exitCode=0
May 26 16:17:52.259298 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.258941    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"
May 26 16:17:52.259298 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.258955    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" event={"ID":"e81fbc29-c258-43c5-9121-32d1cb57bcc3","Type":"ContainerDied","Data":"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"}
May 26 16:17:52.259298 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.258996    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck" event={"ID":"e81fbc29-c258-43c5-9121-32d1cb57bcc3","Type":"ContainerDied","Data":"a58648420cc4bf4fc8a1cb6c1b9740103772f6710dd21fcf90abcb12c5a7f90b"}
May 26 16:17:52.259298 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.259013    2562 scope.go:117] "RemoveContainer" containerID="fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"
May 26 16:17:52.267876 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.267802    2562 scope.go:117] "RemoveContainer" containerID="fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"
May 26 16:17:52.268103 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:17:52.268085    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e\": container with ID starting with fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e not found: ID does not exist" containerID="fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"
May 26 16:17:52.268154 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.268111    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e"} err="failed to get container status \"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e\": rpc error: code = NotFound desc = could not find container \"fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e\": container with ID starting with fb84fccfe32b3bcb0ef9128e1678e45db129cf37a9b0e7b89d3f3830c578084e not found: ID does not exist"
May 26 16:17:52.288528 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.288501    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:52.293382 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:52.293359    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2q6ck"]
May 26 16:17:53.526947 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:53.526918    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" path="/var/lib/kubelet/pods/e81fbc29-c258-43c5-9121-32d1cb57bcc3/volumes"
May 26 16:17:55.658021 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.657987    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"]
May 26 16:17:55.658396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.658260    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" containerName="manager"
May 26 16:17:55.658396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.658270    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" containerName="manager"
May 26 16:17:55.658396 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.658315    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="e81fbc29-c258-43c5-9121-32d1cb57bcc3" containerName="manager"
May 26 16:17:55.664944 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.664911    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.667293 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.667269    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vc2t7\""
May 26 16:17:55.674497 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.674471    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"]
May 26 16:17:55.738925 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.738891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.738943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-kube-api-access-kr5b7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.738967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.738992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.739016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cbe074-9928-4a5e-8476-bd8492e4afd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739066 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.739039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739303 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.739161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739303 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.739200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.739303 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.739239    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840508 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840454    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-kube-api-access-kr5b7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840508 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840509    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840528    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840554    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cbe074-9928-4a5e-8476-bd8492e4afd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840580    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840636    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840666    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.840736 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840700    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.840747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841245 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.841223    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841395 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.841222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841512 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.841261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841512 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.841378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cbe074-9928-4a5e-8476-bd8492e4afd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.841512 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.841412    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.842873 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.842853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.843166 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.843148    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.849045 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.849019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.849045 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.849031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5b7\" (UniqueName: \"kubernetes.io/projected/40cbe074-9928-4a5e-8476-bd8492e4afd4-kube-api-access-kr5b7\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-5c6g4\" (UID: \"40cbe074-9928-4a5e-8476-bd8492e4afd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:55.977747 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:55.977662    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:17:56.111390 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:56.111360    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"]
May 26 16:17:56.115711 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:17:56.115679    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cbe074_9928_4a5e_8476_bd8492e4afd4.slice/crio-3f3d19bf54ba6084e601a019e170ae1fc58c2a43fae461d4df98f698c00927bd WatchSource:0}: Error finding container 3f3d19bf54ba6084e601a019e170ae1fc58c2a43fae461d4df98f698c00927bd: Status 404 returned error can't find the container with id 3f3d19bf54ba6084e601a019e170ae1fc58c2a43fae461d4df98f698c00927bd
May 26 16:17:56.272269 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:17:56.272180    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4" event={"ID":"40cbe074-9928-4a5e-8476-bd8492e4afd4","Type":"ContainerStarted","Data":"3f3d19bf54ba6084e601a019e170ae1fc58c2a43fae461d4df98f698c00927bd"}
May 26 16:18:00.904927 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:00.904896    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 16:18:00.905166 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:00.904961    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 16:18:00.905166 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:00.904987    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 16:18:01.293882 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:01.293843    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4" event={"ID":"40cbe074-9928-4a5e-8476-bd8492e4afd4","Type":"ContainerStarted","Data":"34c5667ed8b33129c33bbdde4c00633bde899f081e0143b00eca1fb13160f110"}
May 26 16:18:01.315410 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:01.315346    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4" podStartSLOduration=1.52878487 podStartE2EDuration="6.315328968s" podCreationTimestamp="2026-05-26 16:17:55 +0000 UTC" firstStartedPulling="2026-05-26 16:17:56.118060485 +0000 UTC m=+569.122284021" lastFinishedPulling="2026-05-26 16:18:00.904604571 +0000 UTC m=+573.908828119" observedRunningTime="2026-05-26 16:18:01.314085217 +0000 UTC m=+574.318308817" watchObservedRunningTime="2026-05-26 16:18:01.315328968 +0000 UTC m=+574.319552523"
May 26 16:18:01.978422 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:01.978383    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:18:01.983051 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:01.983027    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:18:02.297427 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:02.297391    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:18:02.298280 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:02.298263    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-5c6g4"
May 26 16:18:10.345862 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.345811    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:10.349236 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.349219    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.351626 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.351604    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 26 16:18:10.351626 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.351624    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-282kx\""
May 26 16:18:10.359339 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.359314    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:10.445280 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.445252    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:10.464244 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.464203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.464399 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.464267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvpvw\" (UniqueName: \"kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.565107 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.565074    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.565275 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.565151    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvpvw\" (UniqueName: \"kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.565729 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.565708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.574069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.574044    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvpvw\" (UniqueName: \"kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw\") pod \"limitador-limitador-7d549b5b-jw2cp\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") " pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.658939 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.658856    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:10.792571 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:10.792542    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:10.796367 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:18:10.796337    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084a12d8_9ccb_4dee_9e69_86234ef3ea33.slice/crio-1d6d76fce40c8a8de02d08a3c481ef4a287a6d90e8c822c74efe6d2f72a95aad WatchSource:0}: Error finding container 1d6d76fce40c8a8de02d08a3c481ef4a287a6d90e8c822c74efe6d2f72a95aad: Status 404 returned error can't find the container with id 1d6d76fce40c8a8de02d08a3c481ef4a287a6d90e8c822c74efe6d2f72a95aad
May 26 16:18:11.327561 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:11.327528    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" event={"ID":"084a12d8-9ccb-4dee-9e69-86234ef3ea33","Type":"ContainerStarted","Data":"1d6d76fce40c8a8de02d08a3c481ef4a287a6d90e8c822c74efe6d2f72a95aad"}
May 26 16:18:14.339704 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:14.339669    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" event={"ID":"084a12d8-9ccb-4dee-9e69-86234ef3ea33","Type":"ContainerStarted","Data":"524e866f6d4754c421f6cc5951bfa77fac80aee54ed5ded9e0dcb84c6eecab21"}
May 26 16:18:14.340146 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:14.339791    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:14.357041 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:14.356996    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" podStartSLOduration=1.6566541350000001 podStartE2EDuration="4.356982812s" podCreationTimestamp="2026-05-26 16:18:10 +0000 UTC" firstStartedPulling="2026-05-26 16:18:10.798010474 +0000 UTC m=+583.802234006" lastFinishedPulling="2026-05-26 16:18:13.498339147 +0000 UTC m=+586.502562683" observedRunningTime="2026-05-26 16:18:14.355531663 +0000 UTC m=+587.359755218" watchObservedRunningTime="2026-05-26 16:18:14.356982812 +0000 UTC m=+587.361206378"
May 26 16:18:24.854109 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:24.854069    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:24.854582 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:24.854381    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" podUID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" containerName="limitador" containerID="cri-o://524e866f6d4754c421f6cc5951bfa77fac80aee54ed5ded9e0dcb84c6eecab21" gracePeriod=30
May 26 16:18:24.855073 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:24.854951    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:25.377438 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.377404    2562 generic.go:358] "Generic (PLEG): container finished" podID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" containerID="524e866f6d4754c421f6cc5951bfa77fac80aee54ed5ded9e0dcb84c6eecab21" exitCode=0
May 26 16:18:25.377587 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.377481    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" event={"ID":"084a12d8-9ccb-4dee-9e69-86234ef3ea33","Type":"ContainerDied","Data":"524e866f6d4754c421f6cc5951bfa77fac80aee54ed5ded9e0dcb84c6eecab21"}
May 26 16:18:25.400733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.400715    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:25.491205 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.491136    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvpvw\" (UniqueName: \"kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw\") pod \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") "
May 26 16:18:25.491205 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.491185    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file\") pod \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\" (UID: \"084a12d8-9ccb-4dee-9e69-86234ef3ea33\") "
May 26 16:18:25.491474 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.491453    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file" (OuterVolumeSpecName: "config-file") pod "084a12d8-9ccb-4dee-9e69-86234ef3ea33" (UID: "084a12d8-9ccb-4dee-9e69-86234ef3ea33"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 16:18:25.493172 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.493148    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw" (OuterVolumeSpecName: "kube-api-access-kvpvw") pod "084a12d8-9ccb-4dee-9e69-86234ef3ea33" (UID: "084a12d8-9ccb-4dee-9e69-86234ef3ea33"). InnerVolumeSpecName "kube-api-access-kvpvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:18:25.591993 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.591952    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvpvw\" (UniqueName: \"kubernetes.io/projected/084a12d8-9ccb-4dee-9e69-86234ef3ea33-kube-api-access-kvpvw\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:18:25.591993 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:25.591986    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/084a12d8-9ccb-4dee-9e69-86234ef3ea33-config-file\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:18:26.381711 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:26.381684    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp"
May 26 16:18:26.382208 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:26.381711    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-jw2cp" event={"ID":"084a12d8-9ccb-4dee-9e69-86234ef3ea33","Type":"ContainerDied","Data":"1d6d76fce40c8a8de02d08a3c481ef4a287a6d90e8c822c74efe6d2f72a95aad"}
May 26 16:18:26.382208 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:26.381757    2562 scope.go:117] "RemoveContainer" containerID="524e866f6d4754c421f6cc5951bfa77fac80aee54ed5ded9e0dcb84c6eecab21"
May 26 16:18:26.401144 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:26.401121    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:26.404559 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:26.404538    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-jw2cp"]
May 26 16:18:27.527739 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:27.527704    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" path="/var/lib/kubelet/pods/084a12d8-9ccb-4dee-9e69-86234ef3ea33/volumes"
May 26 16:18:28.234371 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.234333    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kgd2s"]
May 26 16:18:28.234887 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.234867    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" containerName="limitador"
May 26 16:18:28.234943 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.234891    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" containerName="limitador"
May 26 16:18:28.234999 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.234987    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="084a12d8-9ccb-4dee-9e69-86234ef3ea33" containerName="limitador"
May 26 16:18:28.239445 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.239423    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.242254 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.241957    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
May 26 16:18:28.242254 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.242033    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z92p7\""
May 26 16:18:28.244057 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.244034    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kgd2s"]
May 26 16:18:28.314197 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.314162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c8fb94-9095-40a2-9a18-d228aebe3fe0-data\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.314355 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.314246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwjj5\" (UniqueName: \"kubernetes.io/projected/97c8fb94-9095-40a2-9a18-d228aebe3fe0-kube-api-access-vwjj5\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.415136 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.415101    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c8fb94-9095-40a2-9a18-d228aebe3fe0-data\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.415294 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.415187    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vwjj5\" (UniqueName: \"kubernetes.io/projected/97c8fb94-9095-40a2-9a18-d228aebe3fe0-kube-api-access-vwjj5\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.415487 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.415469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97c8fb94-9095-40a2-9a18-d228aebe3fe0-data\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.426788 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.426761    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwjj5\" (UniqueName: \"kubernetes.io/projected/97c8fb94-9095-40a2-9a18-d228aebe3fe0-kube-api-access-vwjj5\") pod \"postgres-68c4fbbd6f-kgd2s\" (UID: \"97c8fb94-9095-40a2-9a18-d228aebe3fe0\") " pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.551234 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.551199    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:28.677017 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:28.676993    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-kgd2s"]
May 26 16:18:28.679461 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:18:28.679435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c8fb94_9095_40a2_9a18_d228aebe3fe0.slice/crio-42172ec4cfdf022e2725df15cb97857ba641efd877f80f85ad007c8d645d9be5 WatchSource:0}: Error finding container 42172ec4cfdf022e2725df15cb97857ba641efd877f80f85ad007c8d645d9be5: Status 404 returned error can't find the container with id 42172ec4cfdf022e2725df15cb97857ba641efd877f80f85ad007c8d645d9be5
May 26 16:18:29.393989 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:29.393952    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kgd2s" event={"ID":"97c8fb94-9095-40a2-9a18-d228aebe3fe0","Type":"ContainerStarted","Data":"42172ec4cfdf022e2725df15cb97857ba641efd877f80f85ad007c8d645d9be5"}
May 26 16:18:34.412414 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:34.412378    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-kgd2s" event={"ID":"97c8fb94-9095-40a2-9a18-d228aebe3fe0","Type":"ContainerStarted","Data":"2ef9f63dbd02a6bc29d20b98ea7a6aa47a19e63b12758cdec7204fe1ffdfb695"}
May 26 16:18:34.412803 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:34.412520    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:34.429147 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:34.429097    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-kgd2s" podStartSLOduration=1.689320124 podStartE2EDuration="6.42908618s" podCreationTimestamp="2026-05-26 16:18:28 +0000 UTC" firstStartedPulling="2026-05-26 16:18:28.680864932 +0000 UTC m=+601.685088483" lastFinishedPulling="2026-05-26 16:18:33.420631003 +0000 UTC m=+606.424854539" observedRunningTime="2026-05-26 16:18:34.428637489 +0000 UTC m=+607.432861043" watchObservedRunningTime="2026-05-26 16:18:34.42908618 +0000 UTC m=+607.433309735"
May 26 16:18:40.444949 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:40.444921    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-kgd2s"
May 26 16:18:45.826835 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.826775    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:18:45.830352 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.830331    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:45.832783 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.832759    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 16:18:45.832916 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.832768    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4lfgt\""
May 26 16:18:45.841753 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.841730    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:18:45.864265 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.864235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chvp7\" (UniqueName: \"kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7\") pod \"maas-controller-688b5559bf-l8g5l\" (UID: \"b1d866b2-7c61-4b32-8351-a0988961c055\") " pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:45.964835 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.964774    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chvp7\" (UniqueName: \"kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7\") pod \"maas-controller-688b5559bf-l8g5l\" (UID: \"b1d866b2-7c61-4b32-8351-a0988961c055\") " pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:45.973299 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:45.973268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chvp7\" (UniqueName: \"kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7\") pod \"maas-controller-688b5559bf-l8g5l\" (UID: \"b1d866b2-7c61-4b32-8351-a0988961c055\") " pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:46.140130 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:46.140015    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:46.267599 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:46.267575    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:18:46.270160 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:18:46.270128    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d866b2_7c61_4b32_8351_a0988961c055.slice/crio-092ee70e0f1626f48cc23b4127d0c5bd40e3cd40cc0b8846ba1bb1cda99c8ff1 WatchSource:0}: Error finding container 092ee70e0f1626f48cc23b4127d0c5bd40e3cd40cc0b8846ba1bb1cda99c8ff1: Status 404 returned error can't find the container with id 092ee70e0f1626f48cc23b4127d0c5bd40e3cd40cc0b8846ba1bb1cda99c8ff1
May 26 16:18:46.449378 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:46.449291    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688b5559bf-l8g5l" event={"ID":"b1d866b2-7c61-4b32-8351-a0988961c055","Type":"ContainerStarted","Data":"092ee70e0f1626f48cc23b4127d0c5bd40e3cd40cc0b8846ba1bb1cda99c8ff1"}
May 26 16:18:49.463392 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:49.463356    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688b5559bf-l8g5l" event={"ID":"b1d866b2-7c61-4b32-8351-a0988961c055","Type":"ContainerStarted","Data":"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"}
May 26 16:18:49.463880 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:49.463469    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:18:49.498505 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:18:49.498455    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-688b5559bf-l8g5l" podStartSLOduration=1.5121361800000002 podStartE2EDuration="4.498439372s" podCreationTimestamp="2026-05-26 16:18:45 +0000 UTC" firstStartedPulling="2026-05-26 16:18:46.271499326 +0000 UTC m=+619.275722864" lastFinishedPulling="2026-05-26 16:18:49.257802508 +0000 UTC m=+622.262026056" observedRunningTime="2026-05-26 16:18:49.496577743 +0000 UTC m=+622.500801298" watchObservedRunningTime="2026-05-26 16:18:49.498439372 +0000 UTC m=+622.502662926"
May 26 16:19:00.430458 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.430418    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:19:00.430919 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.430721    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-688b5559bf-l8g5l" podUID="b1d866b2-7c61-4b32-8351-a0988961c055" containerName="manager" containerID="cri-o://c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7" gracePeriod=30
May 26 16:19:00.440069 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.440040    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:19:00.667313 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.667287    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:19:00.786473 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.786445    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chvp7\" (UniqueName: \"kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7\") pod \"b1d866b2-7c61-4b32-8351-a0988961c055\" (UID: \"b1d866b2-7c61-4b32-8351-a0988961c055\") "
May 26 16:19:00.788527 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.788506    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7" (OuterVolumeSpecName: "kube-api-access-chvp7") pod "b1d866b2-7c61-4b32-8351-a0988961c055" (UID: "b1d866b2-7c61-4b32-8351-a0988961c055"). InnerVolumeSpecName "kube-api-access-chvp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:19:00.887357 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:00.887315    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chvp7\" (UniqueName: \"kubernetes.io/projected/b1d866b2-7c61-4b32-8351-a0988961c055-kube-api-access-chvp7\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:19:01.500031 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.499991    2562 generic.go:358] "Generic (PLEG): container finished" podID="b1d866b2-7c61-4b32-8351-a0988961c055" containerID="c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7" exitCode=0
May 26 16:19:01.500482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.500039    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688b5559bf-l8g5l" event={"ID":"b1d866b2-7c61-4b32-8351-a0988961c055","Type":"ContainerDied","Data":"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"}
May 26 16:19:01.500482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.500070    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688b5559bf-l8g5l" event={"ID":"b1d866b2-7c61-4b32-8351-a0988961c055","Type":"ContainerDied","Data":"092ee70e0f1626f48cc23b4127d0c5bd40e3cd40cc0b8846ba1bb1cda99c8ff1"}
May 26 16:19:01.500482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.500078    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688b5559bf-l8g5l"
May 26 16:19:01.500482 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.500088    2562 scope.go:117] "RemoveContainer" containerID="c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"
May 26 16:19:01.508053 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.508034    2562 scope.go:117] "RemoveContainer" containerID="c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"
May 26 16:19:01.508325 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:19:01.508306    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7\": container with ID starting with c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7 not found: ID does not exist" containerID="c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"
May 26 16:19:01.508399 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.508339    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7"} err="failed to get container status \"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7\": rpc error: code = NotFound desc = could not find container \"c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7\": container with ID starting with c60ed9894f6a17cb783d6d676537f9f973f80488ac296e967c527b2168cbe1a7 not found: ID does not exist"
May 26 16:19:01.527391 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.527367    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:19:01.531828 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:01.531794    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-688b5559bf-l8g5l"]
May 26 16:19:03.527712 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:03.527677    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1d866b2-7c61-4b32-8351-a0988961c055" path="/var/lib/kubelet/pods/b1d866b2-7c61-4b32-8351-a0988961c055/volumes"
May 26 16:19:23.160477 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.160424    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-656f695498-m68m4"]
May 26 16:19:23.160983 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.160739    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1d866b2-7c61-4b32-8351-a0988961c055" containerName="manager"
May 26 16:19:23.160983 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.160751    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1d866b2-7c61-4b32-8351-a0988961c055" containerName="manager"
May 26 16:19:23.160983 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.160811    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="b1d866b2-7c61-4b32-8351-a0988961c055" containerName="manager"
May 26 16:19:23.165124 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.165103    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.167602 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.167583    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 26 16:19:23.167674 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.167583    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-z88xr\""
May 26 16:19:23.175342 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.175320    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-656f695498-m68m4"]
May 26 16:19:23.280570 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.280538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.280744 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.280661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8hkq\" (UniqueName: \"kubernetes.io/projected/d332e9dc-537f-452c-98df-88b87971ccc1-kube-api-access-h8hkq\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.381226 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.381188    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8hkq\" (UniqueName: \"kubernetes.io/projected/d332e9dc-537f-452c-98df-88b87971ccc1-kube-api-access-h8hkq\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.381428 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.381281    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.381523 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:19:23.381431    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
May 26 16:19:23.381523 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:19:23.381516    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls podName:d332e9dc-537f-452c-98df-88b87971ccc1 nodeName:}" failed. No retries permitted until 2026-05-26 16:19:23.881493746 +0000 UTC m=+656.885717287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls") pod "maas-api-656f695498-m68m4" (UID: "d332e9dc-537f-452c-98df-88b87971ccc1") : secret "maas-api-serving-cert" not found
May 26 16:19:23.390566 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.390543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8hkq\" (UniqueName: \"kubernetes.io/projected/d332e9dc-537f-452c-98df-88b87971ccc1-kube-api-access-h8hkq\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.885020 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.884974    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:23.887645 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:23.887619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d332e9dc-537f-452c-98df-88b87971ccc1-maas-api-tls\") pod \"maas-api-656f695498-m68m4\" (UID: \"d332e9dc-537f-452c-98df-88b87971ccc1\") " pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:24.076745 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:24.076707    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:24.205090 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:24.205062    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-656f695498-m68m4"]
May 26 16:19:24.207361 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:19:24.207338    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd332e9dc_537f_452c_98df_88b87971ccc1.slice/crio-04d1ed601c654358773ad6c4903cd1db184eddc5d750982adbe6c7cf87a732c1 WatchSource:0}: Error finding container 04d1ed601c654358773ad6c4903cd1db184eddc5d750982adbe6c7cf87a732c1: Status 404 returned error can't find the container with id 04d1ed601c654358773ad6c4903cd1db184eddc5d750982adbe6c7cf87a732c1
May 26 16:19:24.574095 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:24.574055    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-656f695498-m68m4" event={"ID":"d332e9dc-537f-452c-98df-88b87971ccc1","Type":"ContainerStarted","Data":"04d1ed601c654358773ad6c4903cd1db184eddc5d750982adbe6c7cf87a732c1"}
May 26 16:19:26.582561 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:26.582523    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-656f695498-m68m4" event={"ID":"d332e9dc-537f-452c-98df-88b87971ccc1","Type":"ContainerStarted","Data":"e1508f53767ba445957a4048ba3283458b99eb5ff7466afedd71f8b1f768e609"}
May 26 16:19:26.582976 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:26.582627    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:26.600303 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:26.600256    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-656f695498-m68m4" podStartSLOduration=1.688083325 podStartE2EDuration="3.60024242s" podCreationTimestamp="2026-05-26 16:19:23 +0000 UTC" firstStartedPulling="2026-05-26 16:19:24.208631953 +0000 UTC m=+657.212855500" lastFinishedPulling="2026-05-26 16:19:26.120791059 +0000 UTC m=+659.125014595" observedRunningTime="2026-05-26 16:19:26.598500229 +0000 UTC m=+659.602723794" watchObservedRunningTime="2026-05-26 16:19:26.60024242 +0000 UTC m=+659.604465975"
May 26 16:19:32.593208 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:32.593176    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-656f695498-m68m4"
May 26 16:19:48.181911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.181876    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"]
May 26 16:19:48.186846 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.186808    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.190579 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.190556    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jrr2g\""
May 26 16:19:48.190702 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.190589    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 16:19:48.190702 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.190605    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 16:19:48.190702 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.190593    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 26 16:19:48.195535 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.195507    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"]
May 26 16:19:48.290927 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.290889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl2nm\" (UniqueName: \"kubernetes.io/projected/8cf7cff3-395e-4882-9daa-f6edafbdd982-kube-api-access-jl2nm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.290927 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.290932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.291143 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.290954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.291143 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.290974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.291143 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.291081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.291143 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.291115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf7cff3-395e-4882-9daa-f6edafbdd982-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.391911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.391877    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.391911 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.391920    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf7cff3-395e-4882-9daa-f6edafbdd982-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392183 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.391954    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl2nm\" (UniqueName: \"kubernetes.io/projected/8cf7cff3-395e-4882-9daa-f6edafbdd982-kube-api-access-jl2nm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392183 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.391987    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392183 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.392019    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392183 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.392044    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392434 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.392414    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.392449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.392485 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.392469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.394326 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.394301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf7cff3-395e-4882-9daa-f6edafbdd982-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.394449 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.394362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf7cff3-395e-4882-9daa-f6edafbdd982-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.402266 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.402243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl2nm\" (UniqueName: \"kubernetes.io/projected/8cf7cff3-395e-4882-9daa-f6edafbdd982-kube-api-access-jl2nm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n\" (UID: \"8cf7cff3-395e-4882-9daa-f6edafbdd982\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.497752 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.497657    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:19:48.643890 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.641534    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"]
May 26 16:19:48.645339 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:19:48.645309    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf7cff3_395e_4882_9daa_f6edafbdd982.slice/crio-31dc528df841906dd649e2e44ef54e8ade21491db89e4d99ed1c97e283c32d63 WatchSource:0}: Error finding container 31dc528df841906dd649e2e44ef54e8ade21491db89e4d99ed1c97e283c32d63: Status 404 returned error can't find the container with id 31dc528df841906dd649e2e44ef54e8ade21491db89e4d99ed1c97e283c32d63
May 26 16:19:48.655808 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:48.655776    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n" event={"ID":"8cf7cff3-395e-4882-9daa-f6edafbdd982","Type":"ContainerStarted","Data":"31dc528df841906dd649e2e44ef54e8ade21491db89e4d99ed1c97e283c32d63"}
May 26 16:19:56.165335 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.165301    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"]
May 26 16:19:56.191060 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.191019    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"]
May 26 16:19:56.191247 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.191151    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.193629 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.193599    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 26 16:19:56.259953 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.259841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qrwc\" (UniqueName: \"kubernetes.io/projected/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kube-api-access-7qrwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.259953 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.259895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.259953 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.259927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.260241 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.260019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.260241 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.260080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.260241 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.260128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362558 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362457    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362558 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362527    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362867 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362605    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qrwc\" (UniqueName: \"kubernetes.io/projected/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kube-api-access-7qrwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362867 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362638    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362867 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362670    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.362867 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362745    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.363100 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.362929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.363100 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.363068    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.364025 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.363621    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.366311 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.366261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.366646 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.366606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.371728 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.371684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qrwc\" (UniqueName: \"kubernetes.io/projected/4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c-kube-api-access-7qrwc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn\" (UID: \"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:56.502790 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:56.502707    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:19:57.647630 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:57.647447    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"]
May 26 16:19:57.650267 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:19:57.650234    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cadd174_d9fa_4427_a6d9_e4fe0e5e8a0c.slice/crio-d04136231b7c91781e142c5ac6040216509dc5f4357122dd25edb6d999fa3001 WatchSource:0}: Error finding container d04136231b7c91781e142c5ac6040216509dc5f4357122dd25edb6d999fa3001: Status 404 returned error can't find the container with id d04136231b7c91781e142c5ac6040216509dc5f4357122dd25edb6d999fa3001
May 26 16:19:57.653244 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:57.653226    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:19:57.690719 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:57.690677    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn" event={"ID":"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c","Type":"ContainerStarted","Data":"d04136231b7c91781e142c5ac6040216509dc5f4357122dd25edb6d999fa3001"}
May 26 16:19:57.692244 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:57.692217    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n" event={"ID":"8cf7cff3-395e-4882-9daa-f6edafbdd982","Type":"ContainerStarted","Data":"6041e9b14a939e71aa5dfe5ec2fbe287212a272467a37810d4c08d687b546a12"}
May 26 16:19:58.696765 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:19:58.696726    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn" event={"ID":"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c","Type":"ContainerStarted","Data":"d1c2fbbb7be029e39f4dd23730ebff099a694e16d1dab8b5fb392ff20732fc17"}
May 26 16:20:03.714656 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:03.714619    2562 generic.go:358] "Generic (PLEG): container finished" podID="8cf7cff3-395e-4882-9daa-f6edafbdd982" containerID="6041e9b14a939e71aa5dfe5ec2fbe287212a272467a37810d4c08d687b546a12" exitCode=0
May 26 16:20:03.715158 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:03.714701    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n" event={"ID":"8cf7cff3-395e-4882-9daa-f6edafbdd982","Type":"ContainerDied","Data":"6041e9b14a939e71aa5dfe5ec2fbe287212a272467a37810d4c08d687b546a12"}
May 26 16:20:03.716133 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:03.716112    2562 generic.go:358] "Generic (PLEG): container finished" podID="4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c" containerID="d1c2fbbb7be029e39f4dd23730ebff099a694e16d1dab8b5fb392ff20732fc17" exitCode=0
May 26 16:20:03.716216 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:03.716167    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn" event={"ID":"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c","Type":"ContainerDied","Data":"d1c2fbbb7be029e39f4dd23730ebff099a694e16d1dab8b5fb392ff20732fc17"}
May 26 16:20:06.729182 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.729134    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n" event={"ID":"8cf7cff3-395e-4882-9daa-f6edafbdd982","Type":"ContainerStarted","Data":"4b09c9998472866a7701a69f4671a0cda3e11afd063afa18a49de570a89bc0c5"}
May 26 16:20:06.730004 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.729983    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:20:06.731629 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.731602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn" event={"ID":"4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c","Type":"ContainerStarted","Data":"4e5fae97b976110e61ca07c1db1971801ae50c95e6cae52edcce713cfda844fc"}
May 26 16:20:06.731977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.731959    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:20:06.748904 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.748860    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n" podStartSLOduration=1.303419664 podStartE2EDuration="18.748848342s" podCreationTimestamp="2026-05-26 16:19:48 +0000 UTC" firstStartedPulling="2026-05-26 16:19:48.646807658 +0000 UTC m=+681.651031191" lastFinishedPulling="2026-05-26 16:20:06.092236332 +0000 UTC m=+699.096459869" observedRunningTime="2026-05-26 16:20:06.747370812 +0000 UTC m=+699.751594368" watchObservedRunningTime="2026-05-26 16:20:06.748848342 +0000 UTC m=+699.753071897"
May 26 16:20:06.765912 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:06.765859    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn" podStartSLOduration=8.395010907 podStartE2EDuration="10.765843611s" podCreationTimestamp="2026-05-26 16:19:56 +0000 UTC" firstStartedPulling="2026-05-26 16:20:03.71669324 +0000 UTC m=+696.720916774" lastFinishedPulling="2026-05-26 16:20:06.087525938 +0000 UTC m=+699.091749478" observedRunningTime="2026-05-26 16:20:06.76464287 +0000 UTC m=+699.768866426" watchObservedRunningTime="2026-05-26 16:20:06.765843611 +0000 UTC m=+699.770067167"
May 26 16:20:17.748965 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:17.748882    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn"
May 26 16:20:17.749955 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:20:17.749933    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n"
May 26 16:22:48.196439 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.196404    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5876549c76-htt5t"]
May 26 16:22:48.198733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.198712    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:48.200946 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.200924    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 26 16:22:48.201056 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.201006    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4lfgt\""
May 26 16:22:48.207875 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.207845    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5876549c76-htt5t"]
May 26 16:22:48.352481 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.352436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm9sp\" (UniqueName: \"kubernetes.io/projected/37dc5db8-4fef-4cc3-bc79-2543bc11366f-kube-api-access-nm9sp\") pod \"maas-controller-5876549c76-htt5t\" (UID: \"37dc5db8-4fef-4cc3-bc79-2543bc11366f\") " pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:48.453920 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.453805    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nm9sp\" (UniqueName: \"kubernetes.io/projected/37dc5db8-4fef-4cc3-bc79-2543bc11366f-kube-api-access-nm9sp\") pod \"maas-controller-5876549c76-htt5t\" (UID: \"37dc5db8-4fef-4cc3-bc79-2543bc11366f\") " pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:48.462514 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.462489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm9sp\" (UniqueName: \"kubernetes.io/projected/37dc5db8-4fef-4cc3-bc79-2543bc11366f-kube-api-access-nm9sp\") pod \"maas-controller-5876549c76-htt5t\" (UID: \"37dc5db8-4fef-4cc3-bc79-2543bc11366f\") " pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:48.509808 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.509778    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:48.635434 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:48.635407    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5876549c76-htt5t"]
May 26 16:22:48.638408 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:22:48.638378    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37dc5db8_4fef_4cc3_bc79_2543bc11366f.slice/crio-729f5b5036dda50b7161f733ce063111876b98e0cc4dd6f368f6ca2f9297d768 WatchSource:0}: Error finding container 729f5b5036dda50b7161f733ce063111876b98e0cc4dd6f368f6ca2f9297d768: Status 404 returned error can't find the container with id 729f5b5036dda50b7161f733ce063111876b98e0cc4dd6f368f6ca2f9297d768
May 26 16:22:49.284980 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:49.284941    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5876549c76-htt5t" event={"ID":"37dc5db8-4fef-4cc3-bc79-2543bc11366f","Type":"ContainerStarted","Data":"9f0369992893d6251c7287b8ed71da347d8681438ec6c88b2772fbec6e080603"}
May 26 16:22:49.284980 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:49.284987    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5876549c76-htt5t" event={"ID":"37dc5db8-4fef-4cc3-bc79-2543bc11366f","Type":"ContainerStarted","Data":"729f5b5036dda50b7161f733ce063111876b98e0cc4dd6f368f6ca2f9297d768"}
May 26 16:22:49.285384 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:49.285082    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:22:49.301091 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:22:49.301042    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5876549c76-htt5t" podStartSLOduration=0.805343895 podStartE2EDuration="1.301028541s" podCreationTimestamp="2026-05-26 16:22:48 +0000 UTC" firstStartedPulling="2026-05-26 16:22:48.639975244 +0000 UTC m=+861.644198777" lastFinishedPulling="2026-05-26 16:22:49.135659885 +0000 UTC m=+862.139883423" observedRunningTime="2026-05-26 16:22:49.299682792 +0000 UTC m=+862.303906347" watchObservedRunningTime="2026-05-26 16:22:49.301028541 +0000 UTC m=+862.305252096"
May 26 16:23:00.293633 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:23:00.293601    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5876549c76-htt5t"
May 26 16:33:06.520173 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:06.520138    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:33:06.520716 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:06.520349    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" podUID="36b7b1b0-529e-4287-8875-2508cedf66d7" containerName="manager" containerID="cri-o://6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849" gracePeriod=10
May 26 16:33:06.868050 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:06.868028    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:33:07.001157 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.001122    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume\") pod \"36b7b1b0-529e-4287-8875-2508cedf66d7\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") "
May 26 16:33:07.001303 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.001215    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gxrf\" (UniqueName: \"kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf\") pod \"36b7b1b0-529e-4287-8875-2508cedf66d7\" (UID: \"36b7b1b0-529e-4287-8875-2508cedf66d7\") "
May 26 16:33:07.001574 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.001551    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "36b7b1b0-529e-4287-8875-2508cedf66d7" (UID: "36b7b1b0-529e-4287-8875-2508cedf66d7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 16:33:07.003237 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.003215    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf" (OuterVolumeSpecName: "kube-api-access-8gxrf") pod "36b7b1b0-529e-4287-8875-2508cedf66d7" (UID: "36b7b1b0-529e-4287-8875-2508cedf66d7"). InnerVolumeSpecName "kube-api-access-8gxrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 16:33:07.102728 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.102651    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b7b1b0-529e-4287-8875-2508cedf66d7-extensions-socket-volume\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:33:07.102728 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.102685    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gxrf\" (UniqueName: \"kubernetes.io/projected/36b7b1b0-529e-4287-8875-2508cedf66d7-kube-api-access-8gxrf\") on node \"ip-10-0-133-107.ec2.internal\" DevicePath \"\""
May 26 16:33:07.347308 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.347271    2562 generic.go:358] "Generic (PLEG): container finished" podID="36b7b1b0-529e-4287-8875-2508cedf66d7" containerID="6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849" exitCode=0
May 26 16:33:07.347486 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.347336    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"
May 26 16:33:07.347486 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.347359    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" event={"ID":"36b7b1b0-529e-4287-8875-2508cedf66d7","Type":"ContainerDied","Data":"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"}
May 26 16:33:07.347486 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.347399    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn" event={"ID":"36b7b1b0-529e-4287-8875-2508cedf66d7","Type":"ContainerDied","Data":"a2408e0af3cf95768699a6cecb357b383bd245cbfb1256ad81af05f56417d97d"}
May 26 16:33:07.347486 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.347419    2562 scope.go:117] "RemoveContainer" containerID="6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"
May 26 16:33:07.355760 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.355744    2562 scope.go:117] "RemoveContainer" containerID="6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"
May 26 16:33:07.356093 ip-10-0-133-107 kubenswrapper[2562]: E0526 16:33:07.356076    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849\": container with ID starting with 6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849 not found: ID does not exist" containerID="6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"
May 26 16:33:07.356153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.356103    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849"} err="failed to get container status \"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849\": rpc error: code = NotFound desc = could not find container \"6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849\": container with ID starting with 6b42a47291ba4fcef564bcb58f420e0ee99e20f9ae8c3355a6c50c47d80a2849 not found: ID does not exist"
May 26 16:33:07.372667 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.372645    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:33:07.377501 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.377483    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-t24sn"]
May 26 16:33:07.527871 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:33:07.527809    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b7b1b0-529e-4287-8875-2508cedf66d7" path="/var/lib/kubelet/pods/36b7b1b0-529e-4287-8875-2508cedf66d7/volumes"
May 26 16:34:12.670504 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.670464    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"]
May 26 16:34:12.670992 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.670828    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b7b1b0-529e-4287-8875-2508cedf66d7" containerName="manager"
May 26 16:34:12.670992 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.670841    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b7b1b0-529e-4287-8875-2508cedf66d7" containerName="manager"
May 26 16:34:12.670992 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.670899    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="36b7b1b0-529e-4287-8875-2508cedf66d7" containerName="manager"
May 26 16:34:12.673740 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.673723    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.676644 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.676623    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nz4hn\""
May 26 16:34:12.686153 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.686134    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"]
May 26 16:34:12.733570 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.733542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.733570 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.733571    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4qb6\" (UniqueName: \"kubernetes.io/projected/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-kube-api-access-v4qb6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.834649 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.834622    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.834649 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.834650    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4qb6\" (UniqueName: \"kubernetes.io/projected/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-kube-api-access-v4qb6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.834983 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.834964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.852057 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.852031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4qb6\" (UniqueName: \"kubernetes.io/projected/4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77-kube-api-access-v4qb6\") pod \"kuadrant-operator-controller-manager-55c7f4c975-xmk47\" (UID: \"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:12.983246 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:12.983171    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:13.110785 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.110713    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"]
May 26 16:34:13.113539 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:34:13.113512    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e505ff7_6f0a_4f92_a9ad_5d2a6fcf6e77.slice/crio-56b437bd3f71879952e10435ee42288ddff1ef3a8eda52c48c1c502a9e9fa0f2 WatchSource:0}: Error finding container 56b437bd3f71879952e10435ee42288ddff1ef3a8eda52c48c1c502a9e9fa0f2: Status 404 returned error can't find the container with id 56b437bd3f71879952e10435ee42288ddff1ef3a8eda52c48c1c502a9e9fa0f2
May 26 16:34:13.115781 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.115767    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:34:13.566352 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.566320    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47" event={"ID":"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77","Type":"ContainerStarted","Data":"aa46e347a98f70f8e1d0779a8dd64fadd5666f316cee74ef99716837592ce416"}
May 26 16:34:13.566352 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.566352    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47" event={"ID":"4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77","Type":"ContainerStarted","Data":"56b437bd3f71879952e10435ee42288ddff1ef3a8eda52c48c1c502a9e9fa0f2"}
May 26 16:34:13.566600 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.566433    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:34:13.587543 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:13.587496    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47" podStartSLOduration=1.587480604 podStartE2EDuration="1.587480604s" podCreationTimestamp="2026-05-26 16:34:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:34:13.586451354 +0000 UTC m=+1546.590674909" watchObservedRunningTime="2026-05-26 16:34:13.587480604 +0000 UTC m=+1546.591704160"
May 26 16:34:24.572537 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:34:24.572505    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-xmk47"
May 26 16:44:04.575032 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:04.575001    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rkvqp_11d19be1-ed8f-40b1-92d3-104cb7a58100/manager/0.log"
May 26 16:44:04.701052 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:04.701019    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-656f695498-m68m4_d332e9dc-537f-452c-98df-88b87971ccc1/maas-api/0.log"
May 26 16:44:04.954030 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:04.953944    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5876549c76-htt5t_37dc5db8-4fef-4cc3-bc79-2543bc11366f/manager/0.log"
May 26 16:44:05.087609 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:05.087576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2vcjg_fb3e25da-1dfe-4188-bb5c-268142b3d4fd/manager/2.log"
May 26 16:44:05.318193 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:05.318161    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74889b64d-ltqmb_a385ee42-d500-441c-a0ad-57a5df03c66b/manager/0.log"
May 26 16:44:05.560944 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:05.560902    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kgd2s_97c8fb94-9095-40a2-9a18-d228aebe3fe0/postgres/0.log"
May 26 16:44:07.153908 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:07.153877    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5vdjc_60979a14-4d2e-4e42-a506-23d1d89864b8/manager/0.log"
May 26 16:44:07.520809 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:07.520737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xmk47_4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77/manager/0.log"
May 26 16:44:08.245804 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:08.245773    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-krlmj_036abf9b-0c7d-43a0-b981-10f28a19d01e/discovery/0.log"
May 26 16:44:08.476566 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:08.476464    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78464866b8-mfdwr_1d9c0861-3a9f-472d-899d-571a54420281/kube-auth-proxy/0.log"
May 26 16:44:08.601170 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:08.601141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-5c6g4_40cbe074-9928-4a5e-8476-bd8492e4afd4/istio-proxy/0.log"
May 26 16:44:09.570900 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:09.570872    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn_4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c/main/0.log"
May 26 16:44:09.583546 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:09.583520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccd48kn_4cadd174-d9fa-4427-a6d9-e4fe0e5e8a0c/storage-initializer/0.log"
May 26 16:44:09.708997 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:09.708973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n_8cf7cff3-395e-4882-9daa-f6edafbdd982/storage-initializer/0.log"
May 26 16:44:09.715802 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:09.715781    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-qbd9n_8cf7cff3-395e-4882-9daa-f6edafbdd982/main/0.log"
May 26 16:44:16.914600 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:16.914520    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tvfqz_a4bdf3eb-14ae-415f-b8f8-f7b4c0977f12/global-pull-secret-syncer/0.log"
May 26 16:44:16.992347 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:16.992315    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mwpg4_d5b1ae93-a5f3-4e46-95f3-5579e3b6a22c/konnectivity-agent/0.log"
May 26 16:44:17.077093 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:17.077059    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-107.ec2.internal_3a5e6230d598a6959a877daf9ec83d5e/haproxy/0.log"
May 26 16:44:21.646180 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:21.646153    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-5vdjc_60979a14-4d2e-4e42-a506-23d1d89864b8/manager/0.log"
May 26 16:44:21.776977 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:21.776927    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-xmk47_4e505ff7-6f0a-4f92-a9ad-5d2a6fcf6e77/manager/0.log"
May 26 16:44:23.803256 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:23.803222    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8tg9b_3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78/node-exporter/0.log"
May 26 16:44:23.823532 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:23.823479    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8tg9b_3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78/kube-rbac-proxy/0.log"
May 26 16:44:23.846298 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:23.846268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8tg9b_3e24bda6-b93a-4536-bf8f-f3bb3b2c1e78/init-textfile/0.log"
May 26 16:44:25.742928 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.742899    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"]
May 26 16:44:25.745371 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.745346    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.747733 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.747709    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cjkn8\"/\"default-dockercfg-tq4sb\""
May 26 16:44:25.747901 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.747709    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjkn8\"/\"kube-root-ca.crt\""
May 26 16:44:25.748930 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.748906    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cjkn8\"/\"openshift-service-ca.crt\""
May 26 16:44:25.752853 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.752475    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"]
May 26 16:44:25.799999 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.799961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-podres\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.799999 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.800016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-sys\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.800235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.800115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-proc\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.800235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.800171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gfb\" (UniqueName: \"kubernetes.io/projected/0e4200f8-7d2b-4558-a70b-16700b042a1f-kube-api-access-s8gfb\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.800235 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.800211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-lib-modules\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.900888 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.900857    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-sys\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.900911    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-proc\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.900952    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gfb\" (UniqueName: \"kubernetes.io/projected/0e4200f8-7d2b-4558-a70b-16700b042a1f-kube-api-access-s8gfb\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.900978    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-lib-modules\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.900980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-sys\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901040 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.901033    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-podres\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901215 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.901060    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-proc\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901215 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.901119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-lib-modules\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.901215 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.901127    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e4200f8-7d2b-4558-a70b-16700b042a1f-podres\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:25.909327 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:25.909294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gfb\" (UniqueName: \"kubernetes.io/projected/0e4200f8-7d2b-4558-a70b-16700b042a1f-kube-api-access-s8gfb\") pod \"perf-node-gather-daemonset-8bhwn\" (UID: \"0e4200f8-7d2b-4558-a70b-16700b042a1f\") " pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:26.056664 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.056637    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:26.185659 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.185631    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"]
May 26 16:44:26.188476 ip-10-0-133-107 kubenswrapper[2562]: W0526 16:44:26.188446    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e4200f8_7d2b_4558_a70b_16700b042a1f.slice/crio-241f8f226f7af9bbc76730a4db74985e0c6ce0d372f118d5af4b25a9192414fe WatchSource:0}: Error finding container 241f8f226f7af9bbc76730a4db74985e0c6ce0d372f118d5af4b25a9192414fe: Status 404 returned error can't find the container with id 241f8f226f7af9bbc76730a4db74985e0c6ce0d372f118d5af4b25a9192414fe
May 26 16:44:26.190114 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.190097    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 16:44:26.608012 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.607973    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn" event={"ID":"0e4200f8-7d2b-4558-a70b-16700b042a1f","Type":"ContainerStarted","Data":"77d945ac46a02d27c1ce70c4eb0c553963759a94c8be69b7693cf33abc2a04d4"}
May 26 16:44:26.608211 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.608019    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn" event={"ID":"0e4200f8-7d2b-4558-a70b-16700b042a1f","Type":"ContainerStarted","Data":"241f8f226f7af9bbc76730a4db74985e0c6ce0d372f118d5af4b25a9192414fe"}
May 26 16:44:26.608211 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.608119    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:26.624251 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:26.624204    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn" podStartSLOduration=1.62419104 podStartE2EDuration="1.62419104s" podCreationTimestamp="2026-05-26 16:44:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 16:44:26.622548907 +0000 UTC m=+2159.626772462" watchObservedRunningTime="2026-05-26 16:44:26.62419104 +0000 UTC m=+2159.628414618"
May 26 16:44:28.247714 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:28.247684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jcxfn_f03c5578-1ea9-4b62-866a-14224b592c0e/dns/0.log"
May 26 16:44:28.267791 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:28.267763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jcxfn_f03c5578-1ea9-4b62-866a-14224b592c0e/kube-rbac-proxy/0.log"
May 26 16:44:28.395568 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:28.395538    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4mmb_78db7de9-47fb-48e4-908e-5c3b01131daa/dns-node-resolver/0.log"
May 26 16:44:28.936296 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:28.936268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m8p7m_58998204-28a6-4576-950a-eece0c4e0065/node-ca/0.log"
May 26 16:44:29.913984 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:29.913944    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-krlmj_036abf9b-0c7d-43a0-b981-10f28a19d01e/discovery/0.log"
May 26 16:44:29.972680 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:29.972654    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-78464866b8-mfdwr_1d9c0861-3a9f-472d-899d-571a54420281/kube-auth-proxy/0.log"
May 26 16:44:30.034247 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:30.034216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-5c6g4_40cbe074-9928-4a5e-8476-bd8492e4afd4/istio-proxy/0.log"
May 26 16:44:30.657464 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:30.657436    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hl6mg_3d7241ac-276d-4b22-9bc2-09cdb5b922d2/serve-healthcheck-canary/0.log"
May 26 16:44:31.302435 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:31.302406    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6ml6_64341843-9ef4-4331-9f15-b5ceb91665f5/kube-rbac-proxy/0.log"
May 26 16:44:31.323407 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:31.323383    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6ml6_64341843-9ef4-4331-9f15-b5ceb91665f5/exporter/0.log"
May 26 16:44:31.344968 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:31.344946    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w6ml6_64341843-9ef4-4331-9f15-b5ceb91665f5/extractor/0.log"
May 26 16:44:32.619905 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:32.619879    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cjkn8/perf-node-gather-daemonset-8bhwn"
May 26 16:44:33.282391 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.282363    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-rkvqp_11d19be1-ed8f-40b1-92d3-104cb7a58100/manager/0.log"
May 26 16:44:33.312109 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.312082    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-656f695498-m68m4_d332e9dc-537f-452c-98df-88b87971ccc1/maas-api/0.log"
May 26 16:44:33.409220 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.409179    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5876549c76-htt5t_37dc5db8-4fef-4cc3-bc79-2543bc11366f/manager/0.log"
May 26 16:44:33.427493 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.427466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2vcjg_fb3e25da-1dfe-4188-bb5c-268142b3d4fd/manager/1.log"
May 26 16:44:33.438906 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.438886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-2vcjg_fb3e25da-1dfe-4188-bb5c-268142b3d4fd/manager/2.log"
May 26 16:44:33.504475 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.504451    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74889b64d-ltqmb_a385ee42-d500-441c-a0ad-57a5df03c66b/manager/0.log"
May 26 16:44:33.547409 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:33.547349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-kgd2s_97c8fb94-9095-40a2-9a18-d228aebe3fe0/postgres/0.log"
May 26 16:44:40.739297 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.739270    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/kube-multus-additional-cni-plugins/0.log"
May 26 16:44:40.759104 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.759074    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/egress-router-binary-copy/0.log"
May 26 16:44:40.781017 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.780998    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/cni-plugins/0.log"
May 26 16:44:40.800741 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.800722    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/bond-cni-plugin/0.log"
May 26 16:44:40.820891 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.820871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/routeoverride-cni/0.log"
May 26 16:44:40.841605 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.841588    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/whereabouts-cni-bincopy/0.log"
May 26 16:44:40.861857 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:40.861840    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hpr5z_7b92edc4-3414-47c2-8de0-c137f9ebcc59/whereabouts-cni/0.log"
May 26 16:44:41.094328 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:41.094297    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t6bmg_94487320-4f78-45a5-8c53-c638c62c73e6/kube-multus/0.log"
May 26 16:44:41.190899 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:41.190869    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7p2l_701d28a7-dc07-49e0-9e8a-60a836437170/network-metrics-daemon/0.log"
May 26 16:44:41.209301 ip-10-0-133-107 kubenswrapper[2562]: I0526 16:44:41.209280    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-v7p2l_701d28a7-dc07-49e0-9e8a-60a836437170/kube-rbac-proxy/0.log"