May 26 19:22:56.636469 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 19:22:56.636482 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 19:22:56.636490 ip-10-0-143-77 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 19:22:56.636786 ip-10-0-143-77 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 19:23:06.736350 ip-10-0-143-77 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 26 19:23:06.736368 ip-10-0-143-77 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 981dd4dc0c404cccbb034bba91302be3 --
May 26 19:25:26.450831 ip-10-0-143-77 systemd[1]: Starting Kubernetes Kubelet...
May 26 19:25:26.918582 ip-10-0-143-77 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:25:26.918582 ip-10-0-143-77 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 19:25:26.918582 ip-10-0-143-77 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:25:26.918582 ip-10-0-143-77 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 19:25:26.918582 ip-10-0-143-77 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:25:26.922121 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.921989    2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 19:25:26.928354 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928338    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:25:26.928354 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928354    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928358    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928362    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928365    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928368    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928371    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928374    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928377    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928380    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928388    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928391    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928394    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928396    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928399    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928402    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928404    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928407    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928409    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928412    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928415    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:25:26.928418 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928417    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928420    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928424    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928427    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928429    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928432    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928435    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928437    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928440    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928442    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928445    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928447    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928450    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928452    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928455    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928457    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928460    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928462    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928465    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:25:26.928915 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928468    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928470    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928473    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928475    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928478    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928480    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928482    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928486    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928488    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928491    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928493    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928496    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928498    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928503    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928506    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928510    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928513    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928515    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928518    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:25:26.929382 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928521    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928524    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928545    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928550    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928555    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928559    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928562    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928566    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928569    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928573    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928576    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928579    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928582    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928585    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928587    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928590    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928592    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928595    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928597    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928600    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:25:26.929853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928604    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928608    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928611    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928613    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928616    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928619    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.928622    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929021    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929026    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929029    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929033    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929036    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929038    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929041    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929044    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929046    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929049    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929051    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929054    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:25:26.930381 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929057    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929060    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929062    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929065    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929067    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929071    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929074    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929078    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929080    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929083    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929085    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929088    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929090    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929093    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929096    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929098    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929116    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929120    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929124    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:25:26.930853 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929128    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929132    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929136    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929139    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929142    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929144    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929147    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929149    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929151    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929154    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929156    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929159    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929163    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929165    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929168    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929171    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929173    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929176    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929178    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929181    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:25:26.931406 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929184    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929186    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929189    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929191    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929194    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929196    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929199    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929201    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929204    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929206    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929209    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929211    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929214    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929216    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929219    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929222    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929225    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929227    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929230    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929232    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:25:26.931909 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929235    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929238    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929241    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929243    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929246    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929248    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929251    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929254    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929257    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929260    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929263    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929266    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929268    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929271    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.929274    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930445    2576 flags.go:64] FLAG: --address="0.0.0.0"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930456    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930462    2576 flags.go:64] FLAG: --anonymous-auth="true"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930466    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930471    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930474    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930478    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 19:25:26.932411 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930483    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930486    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930489    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930493    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930496    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930500    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930503    2576 flags.go:64] FLAG: --cgroup-root=""
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930507    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930510    2576 flags.go:64] FLAG: --client-ca-file=""
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930513    2576 flags.go:64] FLAG: --cloud-config=""
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930516    2576 flags.go:64] FLAG: --cloud-provider="external"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930519    2576 flags.go:64] FLAG: --cluster-dns="[]"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930524    2576 flags.go:64] FLAG: --cluster-domain=""
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930526    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930547    2576 flags.go:64] FLAG: --config-dir=""
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930552    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930556    2576 flags.go:64] FLAG: --container-log-max-files="5"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930561    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930565    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930568    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930572    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930575    2576 flags.go:64] FLAG: --contention-profiling="false"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930578    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930581    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930584    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 19:25:26.932988 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930587    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930591    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930594    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930597    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930600    2576 flags.go:64] FLAG: --enable-load-reader="false"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930604    2576 flags.go:64] FLAG: --enable-server="true"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930607    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930611    2576 flags.go:64] FLAG: --event-burst="100"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930614    2576 flags.go:64] FLAG: --event-qps="50"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930617    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930621    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930625    2576 flags.go:64] FLAG: --eviction-hard=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930629    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930632    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930635    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930638    2576 flags.go:64] FLAG: --eviction-soft=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930641    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930644    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930647    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930650    2576 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930653    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930656    2576 flags.go:64] FLAG: --fail-swap-on="true"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930658    2576 flags.go:64] FLAG: --feature-gates=""
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930662    2576 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930666    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 19:25:26.933609 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930669    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930673    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930676    2576 flags.go:64] FLAG: --healthz-port="10248"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930679    2576 flags.go:64] FLAG: --help="false"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930682    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-143-77.ec2.internal"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930685    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930689    2576 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930692    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930695    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930698    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930701    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930704    2576 flags.go:64] FLAG: --image-service-endpoint=""
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930707    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930710    2576 flags.go:64] FLAG: --kube-api-burst="100"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930713    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930716    2576 flags.go:64] FLAG: --kube-api-qps="50"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930719    2576 flags.go:64] FLAG: --kube-reserved=""
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930723    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930726    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930729    2576 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930732    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930735    2576 flags.go:64] FLAG: --lock-file=""
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930738    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930742    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 19:25:26.934208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930745    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930750    2576 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930753    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930756    2576 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930759    2576 flags.go:64] FLAG: --logging-format="text"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930762    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930766    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930769    2576 flags.go:64] FLAG: --manifest-url=""
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930772    2576 flags.go:64] FLAG: --manifest-url-header=""
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930776    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930780    2576 flags.go:64] FLAG: --max-open-files="1000000"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930784    2576 flags.go:64] FLAG: --max-pods="110"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930788    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930791    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930795    2576 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930798    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930801    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930804    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930807    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930814    2576 flags.go:64] FLAG: --node-status-max-images="50"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930817    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930821    2576 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930824    2576 flags.go:64] FLAG: --pod-cidr=""
May 26 19:25:26.934822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930827    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930834    2576 flags.go:64] FLAG: --pod-manifest-path=""
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930837    2576 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930841    2576 flags.go:64] FLAG: --pods-per-core="0"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930844    2576 flags.go:64] FLAG: --port="10250"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930847    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930850    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05a5bf3de1e427732"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930853    2576 flags.go:64] FLAG: --qos-reserved=""
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930857    2576 flags.go:64] FLAG: --read-only-port="10255"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930860    2576 flags.go:64] FLAG: --register-node="true"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930864    2576 flags.go:64] FLAG: --register-schedulable="true"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930867    2576 flags.go:64] FLAG: --register-with-taints=""
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930876    2576 flags.go:64] FLAG: --registry-burst="10"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930879    2576 flags.go:64] FLAG: --registry-qps="5"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930882    2576 flags.go:64] FLAG: --reserved-cpus=""
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930885    2576 flags.go:64] FLAG: --reserved-memory=""
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930890    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930893    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930896    2576 flags.go:64] FLAG: --rotate-certificates="false"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930899    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930903    2576 flags.go:64] FLAG: --runonce="false"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930906    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930909    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930912    2576 flags.go:64] FLAG: --seccomp-default="false"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930916    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930919    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 19:25:26.935402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930925    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930929    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930932    2576 flags.go:64] FLAG: --storage-driver-password="root"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930935    2576 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930938    2576 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930942    2576 flags.go:64] FLAG: --storage-driver-user="root"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930945    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930948    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930951    2576 flags.go:64] FLAG: --system-cgroups=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930954    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930960    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930963    2576 flags.go:64] FLAG: --tls-cert-file=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930966    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930971    2576 flags.go:64] FLAG: --tls-min-version=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930974    2576 flags.go:64] FLAG: --tls-private-key-file=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930977    2576 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930980    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930983    2576 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930986    2576 flags.go:64] FLAG: --v="2"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930991    2576 flags.go:64] FLAG: --version="false"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.930995    2576 flags.go:64] FLAG: --vmodule=""
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.931000    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.931003    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931097    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931100    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:25:26.936018 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931104    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931107    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931111    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931114    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931116    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931119    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931122    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931127    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931130    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931133    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931135    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931138    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931142    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931145    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931147    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931150    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931152    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931155    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931157    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931160    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:25:26.937120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931162    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931165    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931167    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931170    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931172    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931175    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931178    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931180    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931183    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931186    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931188    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931191    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931193    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931196    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931198    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931201    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931204    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931206    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931209    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:25:26.937639 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931213    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931215    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931218    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931220    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931223    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931227    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931229    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931232    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931234    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931237    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931239    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931244    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931247    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931250    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931253    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931256    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931259    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931262    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931264    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:25:26.938105 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931267    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931271    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931273    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931277    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931280    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931282    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931285    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931288    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931291    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931293    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931296    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931317    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931320    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931325    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931327    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931330    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931333    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931336    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931343    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931346    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:25:26.938596 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931348    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931351    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931354    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931356    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931359    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.931361    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.931950    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.938393    2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.938409    2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938472    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938478    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938481    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938485    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938488    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938491    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:25:26.939120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938495    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938499    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938504    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938508    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938511    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938514    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938516    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938519    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938522    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938525    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938542    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938545    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938548    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938551    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938554    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938557    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938559    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938562    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938564    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938567    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:25:26.939494 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938570    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938572    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938575    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938577    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938580    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938584    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938586    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938589    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938592    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938594    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938597    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938600    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938602    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938605    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938608    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938610    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938613    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938615    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938618    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938620    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:25:26.940006 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938624    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938626    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938629    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938631    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938634    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938636    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938639    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938641    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938644    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938646    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938649    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938652    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938654    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938656    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938659    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938661    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938664    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938668    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938670    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:25:26.940503 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938673    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938676    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938678    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938681    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938684    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938687    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938689    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938692    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938695    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938698    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938700    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938703    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938705    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938708    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938711    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938714    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938716    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938719    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938721    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938724    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:25:26.940993 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938726    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.938731    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938826    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938831    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938835    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938837    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938840    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938842    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938845    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938848    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938851    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938854    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938856    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938859    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938862    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938864    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:25:26.941476 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938867    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938869    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938872    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938874    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938877    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938880    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938882    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938885    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938887    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938890    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938892    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938895    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938898    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938901    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938903    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938906    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938908    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938911    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938913    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:25:26.941886 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938916    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938918    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938921    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938923    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938926    2576 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938928    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938930    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938933    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938936    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938939    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938941    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938944    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938946    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938949    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938951    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938954    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938957    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938960    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938962    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938964    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:25:26.942390 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938967    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938969    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938972    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938974    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938977    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938981    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938983    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938985    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938988    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938990    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938993    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938995    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.938998    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939000    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939003    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939005    2576 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939008    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939010    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939013    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939015    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:25:26.942931 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939020    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939023    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939026    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939029    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939032    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939035    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939038    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939041    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939044    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939047    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939050    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939052    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:26.939055    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.939060    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.939884    2576 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 19:25:26.943420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.941834    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 19:25:26.943812 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.942743    2576 server.go:1019] "Starting client certificate rotation"
May 26 19:25:26.943812 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.942840    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:25:26.943812 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.942879    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:25:26.975459 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.975431    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:25:26.977359 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.977340    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:25:26.990369 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.990349    2576 log.go:25] "Validated CRI v1 runtime API"
May 26 19:25:26.996009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.995993    2576 log.go:25] "Validated CRI v1 image API"
May 26 19:25:26.997247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:26.997222    2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 19:25:27.001335 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.001314    2576 fs.go:135] Filesystem UUIDs: map[2a333778-3d79-4917-b2a6-77a5f2052a41:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8f0fb6b9-6141-4993-abe0-ab89482fed22:/dev/nvme0n1p4]
May 26 19:25:27.001410 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.001334    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 19:25:27.005684 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.005664    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:25:27.006047 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.005944    2576 manager.go:217] Machine: {Timestamp:2026-05-26 19:25:27.005388386 +0000 UTC m=+0.434966427 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100450 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb2e4b242330fbde1e95db735cd7c SystemUUID:ec2fb2e4-b242-330f-bde1-e95db735cd7c BootID:981dd4dc-0c40-4ccc-bb03-4bba91302be3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:44:c7:6b:11:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:44:c7:6b:11:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:39:6a:8b:57:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 19:25:27.006047 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.006046    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 19:25:27.006163 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.006151    2576 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 19:25:27.008762 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.008735    2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 19:25:27.008903 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.008762    2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-77.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 19:25:27.009430 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.009420    2576 topology_manager.go:138] "Creating topology manager with none policy"
May 26 19:25:27.009461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.009432    2576 container_manager_linux.go:306] "Creating device plugin manager"
May 26 19:25:27.009461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.009439    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:25:27.009461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.009450    2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:25:27.010673 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.010663    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:25:27.010930 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.010921    2576 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 19:25:27.013310 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.013301    2576 kubelet.go:491] "Attempting to sync node with API server"
May 26 19:25:27.013347 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.013318    2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 19:25:27.013347 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.013331    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 19:25:27.013347 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.013341    2576 kubelet.go:397] "Adding apiserver pod source"
May 26 19:25:27.013459 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.013355    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 19:25:27.014491 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.014480    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:25:27.014549 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.014497    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:25:27.018442 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.018420    2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 19:25:27.020748 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.020734    2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 19:25:27.021723 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021709    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021728    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021734    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021740    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021749    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021755    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021763    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021773    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021781    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021787    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 19:25:27.021794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.021795    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 19:25:27.022112 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.022103    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 19:25:27.023011 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.023001    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 19:25:27.023011 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.023010    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 19:25:27.026322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.026304    2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-77.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 26 19:25:27.026413 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.026338    2576 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 19:25:27.026413 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.026378    2576 server.go:1295] "Started kubelet"
May 26 19:25:27.026557 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.026491    2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 19:25:27.026557 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.026546    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 26 19:25:27.026655 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.026579    2576 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 19:25:27.026762 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.026522    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 26 19:25:27.027162 ip-10-0-143-77 systemd[1]: Started Kubernetes Kubelet.
May 26 19:25:27.027815 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.027353    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 19:25:27.027815 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.027781    2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 19:25:27.029827 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.029813    2576 server.go:317] "Adding debug handlers to kubelet server"
May 26 19:25:27.032810 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.031833    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-77.ec2.internal.18b334116349d2e3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-77.ec2.internal,UID:ip-10-0-143-77.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-77.ec2.internal,},FirstTimestamp:2026-05-26 19:25:27.026348771 +0000 UTC m=+0.455926813,LastTimestamp:2026-05-26 19:25:27.026348771 +0000 UTC m=+0.455926813,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-77.ec2.internal,}"
May 26 19:25:27.033722 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.033707    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 19:25:27.034786 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.034772    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 19:25:27.035171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.034939    2576 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 19:25:27.035171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.034953    2576 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 19:25:27.035171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.035048    2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 19:25:27.035171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.035092    2576 reconstruct.go:97] "Volume reconstruction finished"
May 26 19:25:27.035171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.035101    2576 reconciler.go:26] "Reconciler: start to sync state"
May 26 19:25:27.035847 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.035828    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.038253 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.038230    2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 19:25:27.038406 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038391    2576 factory.go:153] Registering CRI-O factory
May 26 19:25:27.038471 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038410    2576 factory.go:223] Registration of the crio container factory successfully
May 26 19:25:27.038507 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038500    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 19:25:27.038559 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038510    2576 factory.go:55] Registering systemd factory
May 26 19:25:27.038559 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038519    2576 factory.go:223] Registration of the systemd container factory successfully
May 26 19:25:27.038559 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038557    2576 factory.go:103] Registering Raw factory
May 26 19:25:27.038681 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038571    2576 manager.go:1196] Started watching for new ooms in manager
May 26 19:25:27.038882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.038872    2576 manager.go:319] Starting recovery of all containers
May 26 19:25:27.047199 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.047167    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 26 19:25:27.047451 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.047420    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-77.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 26 19:25:27.048359 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.048341    2576 manager.go:324] Recovery completed
May 26 19:25:27.049774 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.049750    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbgpr"
May 26 19:25:27.053702 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.053689    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.056709 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.056598    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.056709 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.056628    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.056709 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.056640    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.057142 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.057123    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 19:25:27.057142 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.057141    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 19:25:27.057288 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.057173    2576 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:25:27.057288 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.057176    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbgpr"
May 26 19:25:27.060210 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.060197    2576 policy_none.go:49] "None policy: Start"
May 26 19:25:27.060261 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.060213    2576 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 19:25:27.060261 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.060224    2576 state_mem.go:35] "Initializing new in-memory state store"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.096379    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.097603    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.097632    2576 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.097661    2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.097671    2576 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.097716    2576 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
May 26 19:25:27.100908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.099929    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:25:27.103150 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103136    2576 manager.go:341] "Starting Device Plugin manager"
May 26 19:25:27.103254 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.103240    2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 19:25:27.103296 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103257    2576 server.go:85] "Starting device plugin registration server"
May 26 19:25:27.103573 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103559    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 19:25:27.103615 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103582    2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 19:25:27.103675 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103661    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 19:25:27.103759 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103734    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 19:25:27.103759 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.103747    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 19:25:27.104276 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.104256    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 19:25:27.104342 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.104293    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.198546 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.198413    2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"]
May 26 19:25:27.198546 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.198544    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.200608 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.200586    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.200721 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.200619    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.200721 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.200634    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.202002 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.201986    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.202200 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202186    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.202234 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202221    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.202769 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202751    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.202829 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202783    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.202829 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202794    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.202892 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202751    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.202892 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202869    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.202892 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.202886    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.203671 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.203655    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.204121 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204097    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.204184 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204128    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:25:27.204320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204306    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.204401 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204336    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.204401 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204350    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.204401 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204374    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-77.ec2.internal"
May 26 19:25:27.204796 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204781    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:25:27.204865 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204811    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:25:27.204865 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.204826    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeHasSufficientPID"
May 26 19:25:27.212421 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.212407    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-77.ec2.internal"
May 26 19:25:27.212496 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.212426    2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-77.ec2.internal\": node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.227567 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.227541    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.234351 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.234332    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-77.ec2.internal\" not found" node="ip-10-0-143-77.ec2.internal"
May 26 19:25:27.238786 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.238770    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-77.ec2.internal\" not found" node="ip-10-0-143-77.ec2.internal"
May 26 19:25:27.328166 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.328135    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.336039 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.336015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.336129 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.336045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.336129 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.336064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/757123ea7394d91dfada396cec4fd8f0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"757123ea7394d91dfada396cec4fd8f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.428765 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.428725    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.437004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.436979    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.437062 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.437012    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.437062 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.437031    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/757123ea7394d91dfada396cec4fd8f0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"757123ea7394d91dfada396cec4fd8f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.437134 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.437077    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/757123ea7394d91dfada396cec4fd8f0-config\") pod \"kube-apiserver-proxy-ip-10-0-143-77.ec2.internal\" (UID: \"757123ea7394d91dfada396cec4fd8f0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.437134 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.437075    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.437134 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.437093    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/572a33fd098ca0981bf35164ec3c28e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal\" (UID: \"572a33fd098ca0981bf35164ec3c28e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.529506 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.529430    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.537789 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.537768    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.541511 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.541491    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:27.630330 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.630294    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.730781 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.730757    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.831271 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.831201    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.931694 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:27.931671    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:27.943139 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.943119    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 19:25:27.943260 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:27.943244    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:25:28.031805 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:28.031775    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:28.034686 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.034670    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 19:25:28.046025 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.046002    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:25:28.059141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.059114    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:20:27 +0000 UTC" deadline="2028-01-30 20:43:48.388897883 +0000 UTC"
May 26 19:25:28.059141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.059139    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14737h18m20.329761288s"
May 26 19:25:28.065303 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:28.065269    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572a33fd098ca0981bf35164ec3c28e4.slice/crio-e137392c3d54ef8037a9ed512a776dac58eb83673e2f435f4e86692edc748dd0 WatchSource:0}: Error finding container e137392c3d54ef8037a9ed512a776dac58eb83673e2f435f4e86692edc748dd0: Status 404 returned error can't find the container with id e137392c3d54ef8037a9ed512a776dac58eb83673e2f435f4e86692edc748dd0
May 26 19:25:28.065486 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:28.065467    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757123ea7394d91dfada396cec4fd8f0.slice/crio-0a8e796e1df452ad7505e5b9df0a721a4ebb3989c52ea95cdb460d2249a986e9 WatchSource:0}: Error finding container 0a8e796e1df452ad7505e5b9df0a721a4ebb3989c52ea95cdb460d2249a986e9: Status 404 returned error can't find the container with id 0a8e796e1df452ad7505e5b9df0a721a4ebb3989c52ea95cdb460d2249a986e9
May 26 19:25:28.067963 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.067922    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhfrg"
May 26 19:25:28.068543 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.068512    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:25:28.077053 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.077017    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dhfrg"
May 26 19:25:28.100053 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.100009    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:25:28.100339 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.100306    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" event={"ID":"757123ea7394d91dfada396cec4fd8f0","Type":"ContainerStarted","Data":"0a8e796e1df452ad7505e5b9df0a721a4ebb3989c52ea95cdb460d2249a986e9"}
May 26 19:25:28.101216 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.101195    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"572a33fd098ca0981bf35164ec3c28e4","Type":"ContainerStarted","Data":"e137392c3d54ef8037a9ed512a776dac58eb83673e2f435f4e86692edc748dd0"}
May 26 19:25:28.132028 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:28.132004    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:28.156856 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.156832    2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:25:28.232889 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:28.232866    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:28.333375 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:28.333334    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-143-77.ec2.internal\" not found"
May 26 19:25:28.350169 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.350124    2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:25:28.435919 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.435889    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal"
May 26 19:25:28.448738 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.448715    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:25:28.450005 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.449987    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal"
May 26 19:25:28.457862 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:28.457845    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:25:29.014553 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.014495    2576 apiserver.go:52] "Watching apiserver"
May 26 19:25:29.026130 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.026101    2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 19:25:29.026492 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.026466    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-p8452","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal","openshift-multus/multus-w5q56","openshift-multus/network-metrics-daemon-qbzzm","openshift-network-diagnostics/network-check-target-th4nh","openshift-network-operator/iptables-alerter-bnv2p","kube-system/konnectivity-agent-dqjc5","kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h","openshift-cluster-node-tuning-operator/tuned-ct6d5","openshift-multus/multus-additional-cni-plugins-tj5wx","openshift-ovn-kubernetes/ovnkube-node-shbc8"]
May 26 19:25:29.031094 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.031012    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.033164 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.033070    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5q56"
May 26 19:25:29.033770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.033619    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 19:25:29.033770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.033640    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 19:25:29.033770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.033647    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 19:25:29.033770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.033660    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lpjbr\""
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035089    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035172    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.035175    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035242    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5gmpn\""
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035281    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.035353    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035422    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 19:25:29.035585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035504    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 19:25:29.036016 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.035646    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 19:25:29.039104 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.039084    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.040994 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.040975    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 19:25:29.041176 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.041135    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.041477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.041298    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.041630 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.041613    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lgx9m\""
May 26 19:25:29.041710 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.041679    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 19:25:29.041765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.041753    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 19:25:29.042969 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.042951    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 19:25:29.043065 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.042983    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 19:25:29.043065 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.042998    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-k9wkb\""
May 26 19:25:29.043420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.043299    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 19:25:29.043525 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.043417    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jlfr9\""
May 26 19:25:29.043525 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.043437    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 19:25:29.043525 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.043502    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 19:25:29.043989 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.043971    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.045940 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.045749    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-n4t4n\""
May 26 19:25:29.045940 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.045879    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 19:25:29.045940 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.045899    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 19:25:29.046256 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046240    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.046323 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-cni-binary-copy\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046378 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-multus-daemon-config\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046429 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31830eb0-3134-4d8f-84e2-24a6b8747308-host-slash\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.046429 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046399    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfhrr\" (UniqueName: \"kubernetes.io/projected/31830eb0-3134-4d8f-84e2-24a6b8747308-kube-api-access-pfhrr\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.046556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046453    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-multus\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-kubelet\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-etc-kubernetes\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5k2v\" (UniqueName: \"kubernetes.io/projected/9f1a8f1e-67b3-46ab-83b1-734f37eff620-kube-api-access-k5k2v\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-bin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klmhg\" (UniqueName: \"kubernetes.io/projected/290c7486-09e8-482e-9a46-9f8d717645d0-kube-api-access-klmhg\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-os-release\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046811    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc7vh\" (UniqueName: \"kubernetes.io/projected/cceaa09b-1667-44ab-8040-c817956ce806-kube-api-access-fc7vh\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-system-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046848    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-netns\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.046887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-multus-certs\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31830eb0-3134-4d8f-84e2-24a6b8747308-iptables-alerter-script\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f1a8f1e-67b3-46ab-83b1-734f37eff620-host\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-k8s-cni-cncf-io\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.046977    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-conf-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f1a8f1e-67b3-46ab-83b1-734f37eff620-serviceca\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-socket-dir-parent\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047063    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-hostroot\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:29.047195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.047095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-cnibin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.048118 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.048099    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 19:25:29.048286 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.048269    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 19:25:29.048342 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.048292    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pff4h\""
May 26 19:25:29.048512 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.048497    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.050760 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.050741    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7lnj4\""
May 26 19:25:29.050893 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.050788    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 19:25:29.050893 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.050825    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 19:25:29.051019 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.050905    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 19:25:29.051019 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.051001    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 19:25:29.051147 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.051130    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 19:25:29.051199 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.051175    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 19:25:29.077787 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.077759    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:28 +0000 UTC" deadline="2028-02-11 15:14:52.682418998 +0000 UTC"
May 26 19:25:29.077787 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.077786    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15019h49m23.604636137s"
May 26 19:25:29.135790 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.135765    2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 19:25:29.148170 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-kubernetes\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.148320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-lib-modules\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.148320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148206    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.148320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-var-lib-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148302    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k5k2v\" (UniqueName: \"kubernetes.io/projected/9f1a8f1e-67b3-46ab-83b1-734f37eff620-kube-api-access-k5k2v\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-systemd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-node-log\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-config\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-host\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.148524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5q48\" (UniqueName: \"kubernetes.io/projected/1f50beb4-cbef-4380-9e29-5e36b07bae3e-kube-api-access-v5q48\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw8bz\" (UniqueName: \"kubernetes.io/projected/be6699f4-6705-4491-9ab4-da6905a6e96a-kube-api-access-dw8bz\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-etc-tuned\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148654    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-system-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-env-overrides\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148710    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f1a8f1e-67b3-46ab-83b1-734f37eff620-host\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148714    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-system-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148726    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-k8s-cni-cncf-io\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148742    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-conf-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148765    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148772    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9f1a8f1e-67b3-46ab-83b1-734f37eff620-host\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-slash\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-k8s-cni-cncf-io\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-conf-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.148882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-etc-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148907    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-socket-dir-parent\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148931    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-hostroot\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-var-lib-kubelet\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.148997    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-socket-dir-parent\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149003    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149035    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-hostroot\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149067    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-cnibin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149133    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-multus-daemon-config\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149143    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-cnibin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149164    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pfhrr\" (UniqueName: \"kubernetes.io/projected/31830eb0-3134-4d8f-84e2-24a6b8747308-kube-api-access-pfhrr\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149194    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-etc-kubernetes\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-modprobe-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-run\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149268    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-sys-fs\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-kubelet\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-konnectivity-ca\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.149701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqwkd\" (UniqueName: \"kubernetes.io/projected/f41ccf5d-8426-40d9-965a-04315c04393b-kube-api-access-lqwkd\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-log-socket\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-bin\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149479    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-bin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149510    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klmhg\" (UniqueName: \"kubernetes.io/projected/290c7486-09e8-482e-9a46-9f8d717645d0-kube-api-access-klmhg\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-registration-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149608    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149576    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-bin\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-netd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149673    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-os-release\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149751    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-os-release\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-os-release\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149774    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-etc-kubernetes\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-netns\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-script-lib\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.149960    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cnibin\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.150461 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150015    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fc7vh\" (UniqueName: \"kubernetes.io/projected/cceaa09b-1667-44ab-8040-c817956ce806-kube-api-access-fc7vh\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150044    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-netns\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150113    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-netns\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150113    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-multus-certs\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150151    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-run-multus-certs\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-conf\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150064    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-multus-daemon-config\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-systemd\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rv5m\" (UniqueName: \"kubernetes.io/projected/20396956-aeae-4a7f-b43f-3082d433bbef-kube-api-access-4rv5m\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-socket-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150333    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-sys\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150370    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31830eb0-3134-4d8f-84e2-24a6b8747308-iptables-alerter-script\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150395    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-agent-certs\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysconfig\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-tmp\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150565    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.151105 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150606    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f1a8f1e-67b3-46ab-83b1-734f37eff620-serviceca\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-device-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150658    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-systemd-units\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6699f4-6705-4491-9ab4-da6905a6e96a-ovn-node-metrics-cert\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150725    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-cni-binary-copy\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.150732    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150752    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.150838    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:29.650788451 +0000 UTC m=+3.080366502 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-ovn\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150905    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150929    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/31830eb0-3134-4d8f-84e2-24a6b8747308-iptables-alerter-script\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150935    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31830eb0-3134-4d8f-84e2-24a6b8747308-host-slash\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150974    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/31830eb0-3134-4d8f-84e2-24a6b8747308-host-slash\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.150989    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151025    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9f1a8f1e-67b3-46ab-83b1-734f37eff620-serviceca\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151035    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-multus\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151063    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-kubelet\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.151875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151069    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-multus-cni-dir\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.152700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-cni-multus\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.152700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151152    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/290c7486-09e8-482e-9a46-9f8d717645d0-host-var-lib-kubelet\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.152700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.151238    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/290c7486-09e8-482e-9a46-9f8d717645d0-cni-binary-copy\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.154454 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.154434    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:29.154564 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.154461    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:29.154564 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.154473    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:29.154564 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.154551    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:29.654520573 +0000 UTC m=+3.084098606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:29.154737 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.154587    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 19:25:29.157924 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.157901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfhrr\" (UniqueName: \"kubernetes.io/projected/31830eb0-3134-4d8f-84e2-24a6b8747308-kube-api-access-pfhrr\") pod \"iptables-alerter-bnv2p\" (UID: \"31830eb0-3134-4d8f-84e2-24a6b8747308\") " pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.157924 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.157912    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc7vh\" (UniqueName: \"kubernetes.io/projected/cceaa09b-1667-44ab-8040-c817956ce806-kube-api-access-fc7vh\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.158081 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.157901    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klmhg\" (UniqueName: \"kubernetes.io/projected/290c7486-09e8-482e-9a46-9f8d717645d0-kube-api-access-klmhg\") pod \"multus-w5q56\" (UID: \"290c7486-09e8-482e-9a46-9f8d717645d0\") " pod="openshift-multus/multus-w5q56"
May 26 19:25:29.158081 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.157906    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5k2v\" (UniqueName: \"kubernetes.io/projected/9f1a8f1e-67b3-46ab-83b1-734f37eff620-kube-api-access-k5k2v\") pod \"node-ca-p8452\" (UID: \"9f1a8f1e-67b3-46ab-83b1-734f37eff620\") " pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.251588 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251549    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-env-overrides\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.251758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251600    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.251758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251625    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-slash\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.251758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251645    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-etc-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.251758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251667    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-var-lib-kubelet\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.251758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-var-lib-kubelet\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-slash\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-etc-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251783    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-modprobe-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251835    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-run\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251870    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-sys-fs\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251891    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-modprobe-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251900    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-kubelet\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251928    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-konnectivity-ca\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251941    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-run\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251943    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-sys-fs\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251959    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqwkd\" (UniqueName: \"kubernetes.io/projected/f41ccf5d-8426-40d9-965a-04315c04393b-kube-api-access-lqwkd\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.252001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251985    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-kubelet\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.251991    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-log-socket\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252023    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-log-socket\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-bin\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252074    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-registration-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252093    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-env-overrides\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252110    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-netd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252135    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-os-release\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252153    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-netns\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252153    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-bin\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-registration-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252168    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-script-lib\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252201    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-cni-netd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252207    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252207    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252250    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.252477 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252262    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-system-cni-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252265    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-os-release\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252287    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cnibin\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252305    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-netns\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252317    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-conf\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252334    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-systemd\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252346    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cnibin\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252357    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rv5m\" (UniqueName: \"kubernetes.io/projected/20396956-aeae-4a7f-b43f-3082d433bbef-kube-api-access-4rv5m\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252382    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-socket-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252397    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-sys\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252414    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-agent-certs\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252437    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysconfig\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252462    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252470    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-sys\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-konnectivity-ca\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252476    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-conf\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252395    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-systemd\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252487    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-tmp\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.253230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252526    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysconfig\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252561    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-device-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252593    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-systemd-units\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252596    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-script-lib\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252603    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-device-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252623    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-socket-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252632    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6699f4-6705-4491-9ab4-da6905a6e96a-ovn-node-metrics-cert\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252652    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-systemd-units\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252661    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252690    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-sysctl-d\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252696    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-ovn\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252725    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-ovn\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252758    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-kubernetes\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252817    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252820    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-lib-modules\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252869    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-etc-kubernetes\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.254135 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252896    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-lib-modules\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.252971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253005    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-var-lib-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253033    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-systemd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253059    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-node-log\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253085    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-config\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253110    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-host\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253136    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253142    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-node-log\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253135    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-cni-binary-copy\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253109    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-var-lib-openvswitch\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253177    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20396956-aeae-4a7f-b43f-3082d433bbef-host\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253179    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253214    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-etc-selinux\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253221    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5q48\" (UniqueName: \"kubernetes.io/projected/1f50beb4-cbef-4380-9e29-5e36b07bae3e-kube-api-access-v5q48\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-run-systemd\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253137    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f41ccf5d-8426-40d9-965a-04315c04393b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.255004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253249    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253275    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dw8bz\" (UniqueName: \"kubernetes.io/projected/be6699f4-6705-4491-9ab4-da6905a6e96a-kube-api-access-dw8bz\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253302    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-etc-tuned\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253326    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253469    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1f50beb4-cbef-4380-9e29-5e36b07bae3e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be6699f4-6705-4491-9ab4-da6905a6e96a-host-run-ovn-kubernetes\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253645    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be6699f4-6705-4491-9ab4-da6905a6e96a-ovnkube-config\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.253689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1f50beb4-cbef-4380-9e29-5e36b07bae3e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.255386    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be6699f4-6705-4491-9ab4-da6905a6e96a-ovn-node-metrics-cert\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.255563    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3-agent-certs\") pod \"konnectivity-agent-dqjc5\" (UID: \"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3\") " pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.255765 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.255760    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-tmp\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.256121 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.255782    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20396956-aeae-4a7f-b43f-3082d433bbef-etc-tuned\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.260123 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.260099    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqwkd\" (UniqueName: \"kubernetes.io/projected/f41ccf5d-8426-40d9-965a-04315c04393b-kube-api-access-lqwkd\") pod \"aws-ebs-csi-driver-node-kh82h\" (UID: \"f41ccf5d-8426-40d9-965a-04315c04393b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.260412 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.260390    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5q48\" (UniqueName: \"kubernetes.io/projected/1f50beb4-cbef-4380-9e29-5e36b07bae3e-kube-api-access-v5q48\") pod \"multus-additional-cni-plugins-tj5wx\" (UID: \"1f50beb4-cbef-4380-9e29-5e36b07bae3e\") " pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.260592 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.260571    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rv5m\" (UniqueName: \"kubernetes.io/projected/20396956-aeae-4a7f-b43f-3082d433bbef-kube-api-access-4rv5m\") pod \"tuned-ct6d5\" (UID: \"20396956-aeae-4a7f-b43f-3082d433bbef\") " pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.261423 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.261399    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw8bz\" (UniqueName: \"kubernetes.io/projected/be6699f4-6705-4491-9ab4-da6905a6e96a-kube-api-access-dw8bz\") pod \"ovnkube-node-shbc8\" (UID: \"be6699f4-6705-4491-9ab4-da6905a6e96a\") " pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.343514 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.343430    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8452"
May 26 19:25:29.351072 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.351050    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w5q56"
May 26 19:25:29.359820 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.359798    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bnv2p"
May 26 19:25:29.367327 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.367305    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:29.374921 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.374900    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h"
May 26 19:25:29.380565 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.380550    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ct6d5"
May 26 19:25:29.388059 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.388041    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tj5wx"
May 26 19:25:29.392658 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.392641    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:29.442171 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.442144    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:25:29.655517 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.655437    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:29.655517 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:29.655495    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655614    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655635    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655642    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655648    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655712    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:30.655690326 +0000 UTC m=+4.085268362 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:29.655748 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:29.655733    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:30.655722803 +0000 UTC m=+4.085300836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:29.735552 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.735348    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6699f4_6705_4491_9ab4_da6905a6e96a.slice/crio-a3434e22fd6f3ce34f4e5bb6ac32870b6d19e1f89326d8b68661846a9ba41917 WatchSource:0}: Error finding container a3434e22fd6f3ce34f4e5bb6ac32870b6d19e1f89326d8b68661846a9ba41917: Status 404 returned error can't find the container with id a3434e22fd6f3ce34f4e5bb6ac32870b6d19e1f89326d8b68661846a9ba41917
May 26 19:25:29.736492 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.736455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290c7486_09e8_482e_9a46_9f8d717645d0.slice/crio-6e8aee8c44b6f813706f249d0d76338c2d9ccce5c370e2cd5d867a03313c4ff5 WatchSource:0}: Error finding container 6e8aee8c44b6f813706f249d0d76338c2d9ccce5c370e2cd5d867a03313c4ff5: Status 404 returned error can't find the container with id 6e8aee8c44b6f813706f249d0d76338c2d9ccce5c370e2cd5d867a03313c4ff5
May 26 19:25:29.737301 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.737276    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1a8f1e_67b3_46ab_83b1_734f37eff620.slice/crio-a01a271221ba3b8b1701c60876807a73b6bdbf27b2f61d5aeb9825700bec1aaa WatchSource:0}: Error finding container a01a271221ba3b8b1701c60876807a73b6bdbf27b2f61d5aeb9825700bec1aaa: Status 404 returned error can't find the container with id a01a271221ba3b8b1701c60876807a73b6bdbf27b2f61d5aeb9825700bec1aaa
May 26 19:25:29.737944 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.737927    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31830eb0_3134_4d8f_84e2_24a6b8747308.slice/crio-1e6203cfd3f874685a74b6e810a1ecbeef2f0334365eaa869b24b2848e9d24c9 WatchSource:0}: Error finding container 1e6203cfd3f874685a74b6e810a1ecbeef2f0334365eaa869b24b2848e9d24c9: Status 404 returned error can't find the container with id 1e6203cfd3f874685a74b6e810a1ecbeef2f0334365eaa869b24b2848e9d24c9
May 26 19:25:29.739740 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.739717    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f50beb4_cbef_4380_9e29_5e36b07bae3e.slice/crio-124fe937d12c87d34d2b02cb2d13309649ed8d1a1bc06b6712ffdf6dbec9df58 WatchSource:0}: Error finding container 124fe937d12c87d34d2b02cb2d13309649ed8d1a1bc06b6712ffdf6dbec9df58: Status 404 returned error can't find the container with id 124fe937d12c87d34d2b02cb2d13309649ed8d1a1bc06b6712ffdf6dbec9df58
May 26 19:25:29.740362 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.740340    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20396956_aeae_4a7f_b43f_3082d433bbef.slice/crio-d366085135b80e57ec22959781ed92bb8625e6f33b5a8e0acd9f1c9833342d47 WatchSource:0}: Error finding container d366085135b80e57ec22959781ed92bb8625e6f33b5a8e0acd9f1c9833342d47: Status 404 returned error can't find the container with id d366085135b80e57ec22959781ed92bb8625e6f33b5a8e0acd9f1c9833342d47
May 26 19:25:29.743526 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.743488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9bde4a0_f16d_4cd0_ae23_84ccfcb07aa3.slice/crio-d77ca763ff2c817138b04884bd23eb6f4b10ac4c624a8275f9c8f53dbbb834b0 WatchSource:0}: Error finding container d77ca763ff2c817138b04884bd23eb6f4b10ac4c624a8275f9c8f53dbbb834b0: Status 404 returned error can't find the container with id d77ca763ff2c817138b04884bd23eb6f4b10ac4c624a8275f9c8f53dbbb834b0
May 26 19:25:29.744319 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:29.744136    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41ccf5d_8426_40d9_965a_04315c04393b.slice/crio-c23ea4120db4399eeae66845a13d450d477eb72794e4a20d59ddbe4b81853b14 WatchSource:0}: Error finding container c23ea4120db4399eeae66845a13d450d477eb72794e4a20d59ddbe4b81853b14: Status 404 returned error can't find the container with id c23ea4120db4399eeae66845a13d450d477eb72794e4a20d59ddbe4b81853b14
May 26 19:25:30.078440 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.078403    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:20:28 +0000 UTC" deadline="2027-10-27 21:19:41.534391256 +0000 UTC"
May 26 19:25:30.078440 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.078432    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12457h54m11.455962379s"
May 26 19:25:30.104368 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.104341    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h" event={"ID":"f41ccf5d-8426-40d9-965a-04315c04393b","Type":"ContainerStarted","Data":"c23ea4120db4399eeae66845a13d450d477eb72794e4a20d59ddbe4b81853b14"}
May 26 19:25:30.105261 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.105244    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dqjc5" event={"ID":"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3","Type":"ContainerStarted","Data":"d77ca763ff2c817138b04884bd23eb6f4b10ac4c624a8275f9c8f53dbbb834b0"}
May 26 19:25:30.106103 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.106081    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ct6d5" event={"ID":"20396956-aeae-4a7f-b43f-3082d433bbef","Type":"ContainerStarted","Data":"d366085135b80e57ec22959781ed92bb8625e6f33b5a8e0acd9f1c9833342d47"}
May 26 19:25:30.106928 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.106911    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerStarted","Data":"124fe937d12c87d34d2b02cb2d13309649ed8d1a1bc06b6712ffdf6dbec9df58"}
May 26 19:25:30.107734 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.107715    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bnv2p" event={"ID":"31830eb0-3134-4d8f-84e2-24a6b8747308","Type":"ContainerStarted","Data":"1e6203cfd3f874685a74b6e810a1ecbeef2f0334365eaa869b24b2848e9d24c9"}
May 26 19:25:30.108956 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.108926    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" event={"ID":"757123ea7394d91dfada396cec4fd8f0","Type":"ContainerStarted","Data":"19d079ff74588454b7d90bf302ba481c4d5f81ca92f86def24f13bb3ecc3d5a2"}
May 26 19:25:30.110184 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.110164    2576 generic.go:358] "Generic (PLEG): container finished" podID="572a33fd098ca0981bf35164ec3c28e4" containerID="95c199be21128e1b7528d15f6dcf2389bbb55c99e6023d0bb764708c4021df24" exitCode=0
May 26 19:25:30.110247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.110220    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"572a33fd098ca0981bf35164ec3c28e4","Type":"ContainerDied","Data":"95c199be21128e1b7528d15f6dcf2389bbb55c99e6023d0bb764708c4021df24"}
May 26 19:25:30.111175 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.111156    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8452" event={"ID":"9f1a8f1e-67b3-46ab-83b1-734f37eff620","Type":"ContainerStarted","Data":"a01a271221ba3b8b1701c60876807a73b6bdbf27b2f61d5aeb9825700bec1aaa"}
May 26 19:25:30.112184 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.112162    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5q56" event={"ID":"290c7486-09e8-482e-9a46-9f8d717645d0","Type":"ContainerStarted","Data":"6e8aee8c44b6f813706f249d0d76338c2d9ccce5c370e2cd5d867a03313c4ff5"}
May 26 19:25:30.113210 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.113188    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"a3434e22fd6f3ce34f4e5bb6ac32870b6d19e1f89326d8b68661846a9ba41917"}
May 26 19:25:30.121982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.121945    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-77.ec2.internal" podStartSLOduration=2.121922283 podStartE2EDuration="2.121922283s" podCreationTimestamp="2026-05-26 19:25:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:25:30.121789956 +0000 UTC m=+3.551368005" watchObservedRunningTime="2026-05-26 19:25:30.121922283 +0000 UTC m=+3.551500332"
May 26 19:25:30.662556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.662501    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:30.662733 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:30.662595    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:30.662733 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662685    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:30.662733 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662710    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:30.662733 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662724    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:30.662733 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662726    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:30.663009 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662785    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:32.662765741 +0000 UTC m=+6.092343786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:30.663009 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:30.662807    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:32.662796646 +0000 UTC m=+6.092374677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:31.098767 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:31.098698    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:31.099244 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:31.098840    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:31.101120 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:31.101093    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:31.101230 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:31.101195    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:31.147284 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:31.147223    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" event={"ID":"572a33fd098ca0981bf35164ec3c28e4","Type":"ContainerStarted","Data":"3edc30f4f3ba31afe934d909fe1b2fedfec867cf682e1f6e61fc6963bce54395"}
May 26 19:25:31.161522 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:31.160717    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-77.ec2.internal" podStartSLOduration=3.160699624 podStartE2EDuration="3.160699624s" podCreationTimestamp="2026-05-26 19:25:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:25:31.159971146 +0000 UTC m=+4.589549197" watchObservedRunningTime="2026-05-26 19:25:31.160699624 +0000 UTC m=+4.590277674"
May 26 19:25:32.681155 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:32.681061    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:32.681155 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:32.681130    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681239    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681263    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681279    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681335    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:36.68131669 +0000 UTC m=+10.110894720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681243    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:32.681719 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:32.681668    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:36.681649403 +0000 UTC m=+10.111227446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:33.098290 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:33.098216    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:33.098446 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:33.098350    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:33.098748 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:33.098728    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:33.098855 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:33.098835    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:35.101137 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.100707    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:35.101137 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:35.100852    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:35.101137 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.100950    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:35.101137 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:35.101097    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:35.684686 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.684304    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-rsvbh"]
May 26 19:25:35.687998 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.687563    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.690353 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.690329    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-djll7\""
May 26 19:25:35.690455 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.690393    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 19:25:35.690455 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.690400    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 19:25:35.811198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.811045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bfe9d1-d934-4450-8d01-2c074d6d307b-tmp-dir\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.811198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.811123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bfe9d1-d934-4450-8d01-2c074d6d307b-hosts-file\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.811198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.811156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhjz\" (UniqueName: \"kubernetes.io/projected/73bfe9d1-d934-4450-8d01-2c074d6d307b-kube-api-access-xvhjz\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.912333 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.912298    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bfe9d1-d934-4450-8d01-2c074d6d307b-hosts-file\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.912488 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.912350    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhjz\" (UniqueName: \"kubernetes.io/projected/73bfe9d1-d934-4450-8d01-2c074d6d307b-kube-api-access-xvhjz\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.912488 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.912409    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bfe9d1-d934-4450-8d01-2c074d6d307b-tmp-dir\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.912488 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.912428    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/73bfe9d1-d934-4450-8d01-2c074d6d307b-hosts-file\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.912771 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.912752    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73bfe9d1-d934-4450-8d01-2c074d6d307b-tmp-dir\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.923414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.923391    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhjz\" (UniqueName: \"kubernetes.io/projected/73bfe9d1-d934-4450-8d01-2c074d6d307b-kube-api-access-xvhjz\") pod \"node-resolver-rsvbh\" (UID: \"73bfe9d1-d934-4450-8d01-2c074d6d307b\") " pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:35.998575 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:35.998480    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rsvbh"
May 26 19:25:36.310151 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.310056    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-sm7r5"]
May 26 19:25:36.313494 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.313469    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.313651 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.313570    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:36.417159 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.417121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-kubelet-config\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.417321 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.417177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.417321 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.417296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-dbus\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518357 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.518157    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-kubelet-config\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518357 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.518210    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518357 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.518265    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-dbus\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518357 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.518297    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-kubelet-config\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518738 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.518452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/264b0107-4c8f-41a3-8b40-ec3500becd40-dbus\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:36.518738 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.518459    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:36.518738 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.518522    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:37.018504337 +0000 UTC m=+10.448082364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:36.719821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.719737    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:36.719821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:36.719803    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.719928    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.719939    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.719957    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.719966    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.720007    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:44.71998687 +0000 UTC m=+18.149564910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:36.720040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:36.720028    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:44.720018646 +0000 UTC m=+18.149596674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:37.022441 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:37.022327    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:37.022642 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:37.022492    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:37.022642 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:37.022585    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:38.022562645 +0000 UTC m=+11.452140685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:37.099791 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:37.099754    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:37.099968 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:37.099870    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:37.100051 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:37.100029    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:37.100177 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:37.100154    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:38.029902 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:38.029868    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:38.030423 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:38.029979    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:38.030423 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:38.030042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:40.030024569 +0000 UTC m=+13.459602607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:38.098357 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:38.098284    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:38.098551 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:38.098410    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:39.098677 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:39.098618    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:39.099112 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:39.098625    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:39.099112 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:39.098738    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:39.099112 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:39.098842    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:40.045963 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:40.045921    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:40.046139 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:40.046096    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:40.046189 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:40.046164    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:44.046146687 +0000 UTC m=+17.475724720 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:40.098869 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:40.098833    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:40.099269 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:40.098959    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:41.098116 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:41.098067    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:41.098302 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:41.098067    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:41.098302 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:41.098213    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:41.098302 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:41.098283    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:42.098279 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:42.098241    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:42.098764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:42.098389    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:43.098021 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:43.097978    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:43.098223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:43.097980    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:43.098223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:43.098139    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:43.098223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:43.098198    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:44.078854 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:44.078811    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:44.079014 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.078980    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:44.079056 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.079042    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:25:52.079027565 +0000 UTC m=+25.508605598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:44.098446 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:44.098406    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:44.098878 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.098514    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:44.782659 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:44.782614    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:44.782680    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782778    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782778    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782803    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782814    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:44.782842 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782834    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:00.782816894 +0000 UTC m=+34.212394922 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:25:44.783088 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:44.782863    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:00.782846264 +0000 UTC m=+34.212424307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:25:45.098520 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:45.098438    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:45.098956 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:45.098517    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:45.098956 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:45.098641    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:45.098956 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:45.098798    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:46.098225 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:46.098195    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:46.098411 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:46.098295    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:47.100339 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:47.100309    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:47.100339 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:47.100319    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:47.100849 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:47.100417    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:47.100849 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:47.100522    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:47.521892 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:25:47.521854    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bfe9d1_d934_4450_8d01_2c074d6d307b.slice/crio-3b81e6a73623985bc7408497f0e6dc5bcf1b7fa9427f3a34a6af0d2a5adbe6d2 WatchSource:0}: Error finding container 3b81e6a73623985bc7408497f0e6dc5bcf1b7fa9427f3a34a6af0d2a5adbe6d2: Status 404 returned error can't find the container with id 3b81e6a73623985bc7408497f0e6dc5bcf1b7fa9427f3a34a6af0d2a5adbe6d2
May 26 19:25:48.098478 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.098210    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:48.098595 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:48.098576    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:48.173697 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.173667    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h" event={"ID":"f41ccf5d-8426-40d9-965a-04315c04393b","Type":"ContainerStarted","Data":"aaa635e75442dff84ef8c5724462ca69e8225fc837c60b6e3f9c88226c8c1ed0"}
May 26 19:25:48.174872 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.174843    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dqjc5" event={"ID":"e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3","Type":"ContainerStarted","Data":"a2a6fe5650276315d82ae831a30ba8cf246a52d12c5737d9b4937bb71f3ca3f6"}
May 26 19:25:48.175991 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.175971    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ct6d5" event={"ID":"20396956-aeae-4a7f-b43f-3082d433bbef","Type":"ContainerStarted","Data":"199880afd4c76941675b6144b19095916ebe234749eeffff3d60fe5b53cb8d4e"}
May 26 19:25:48.177203 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.177184    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="d164f3c8a0d47fb2e228b34203f14f10aa62574d84331495be42d2ae19a91916" exitCode=0
May 26 19:25:48.177292 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.177238    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"d164f3c8a0d47fb2e228b34203f14f10aa62574d84331495be42d2ae19a91916"}
May 26 19:25:48.178803 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.178777    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsvbh" event={"ID":"73bfe9d1-d934-4450-8d01-2c074d6d307b","Type":"ContainerStarted","Data":"4708217c54425e277e4199bd790dedd894e7a4ebe5ecdba324cf1672d662aa8c"}
May 26 19:25:48.178896 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.178813    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rsvbh" event={"ID":"73bfe9d1-d934-4450-8d01-2c074d6d307b","Type":"ContainerStarted","Data":"3b81e6a73623985bc7408497f0e6dc5bcf1b7fa9427f3a34a6af0d2a5adbe6d2"}
May 26 19:25:48.180097 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.180072    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8452" event={"ID":"9f1a8f1e-67b3-46ab-83b1-734f37eff620","Type":"ContainerStarted","Data":"099f2f39c2aecfa74a5dbc15ee2874d5329f39909c9ff17a79eb333366c87024"}
May 26 19:25:48.181543 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.181493    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w5q56" event={"ID":"290c7486-09e8-482e-9a46-9f8d717645d0","Type":"ContainerStarted","Data":"238596163b07e673ead8d209571ddc24d6fcc9067be9740e753aa495410e02f6"}
May 26 19:25:48.187145 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.187084    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dqjc5" podStartSLOduration=3.423722641 podStartE2EDuration="21.187071041s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.745441829 +0000 UTC m=+3.175019859" lastFinishedPulling="2026-05-26 19:25:47.508790229 +0000 UTC m=+20.938368259" observedRunningTime="2026-05-26 19:25:48.18645911 +0000 UTC m=+21.616037164" watchObservedRunningTime="2026-05-26 19:25:48.187071041 +0000 UTC m=+21.616649092"
May 26 19:25:48.187853 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.187837    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:25:48.188099 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188082    2576 generic.go:358] "Generic (PLEG): container finished" podID="be6699f4-6705-4491-9ab4-da6905a6e96a" containerID="33be5deffc7c55a379aea30ca2da0c15cba16d0ff8b4d4e55ba9a6d246514a9c" exitCode=1
May 26 19:25:48.188141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188106    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"eb0a2b29e2aa77831f2805d8509a6054beca383cf73ce7636e944f169161cd42"}
May 26 19:25:48.188141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188119    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"8a0508e0ac64d644460850063eaba4e2df5356a814c64f0aaf935a36e6807f82"}
May 26 19:25:48.188141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188128    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"d767f432542a62cec791dead9f5fe84013c5f6bfa064cc809e06135caef1f4f4"}
May 26 19:25:48.188141 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188136    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerDied","Data":"33be5deffc7c55a379aea30ca2da0c15cba16d0ff8b4d4e55ba9a6d246514a9c"}
May 26 19:25:48.188257 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.188144    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"66cccb7c1073f0edb1e629aa34b08f3adc0d56d9b7c742e6f3fba9c18a39ced0"}
May 26 19:25:48.210431 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.210392    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-rsvbh" podStartSLOduration=13.21038051 podStartE2EDuration="13.21038051s" podCreationTimestamp="2026-05-26 19:25:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:25:48.209898303 +0000 UTC m=+21.639476353" watchObservedRunningTime="2026-05-26 19:25:48.21038051 +0000 UTC m=+21.639958560"
May 26 19:25:48.233584 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.233543    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ct6d5" podStartSLOduration=3.376342616 podStartE2EDuration="21.233515848s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.742687416 +0000 UTC m=+3.172265461" lastFinishedPulling="2026-05-26 19:25:47.599860656 +0000 UTC m=+21.029438693" observedRunningTime="2026-05-26 19:25:48.233412191 +0000 UTC m=+21.662990241" watchObservedRunningTime="2026-05-26 19:25:48.233515848 +0000 UTC m=+21.663093897"
May 26 19:25:48.233892 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.233870    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-w5q56" podStartSLOduration=3.41887331 podStartE2EDuration="21.233863993s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.738776846 +0000 UTC m=+3.168354874" lastFinishedPulling="2026-05-26 19:25:47.553767523 +0000 UTC m=+20.983345557" observedRunningTime="2026-05-26 19:25:48.222186377 +0000 UTC m=+21.651764426" watchObservedRunningTime="2026-05-26 19:25:48.233863993 +0000 UTC m=+21.663442043"
May 26 19:25:48.245172 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:48.245126    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p8452" podStartSLOduration=3.555458796 podStartE2EDuration="21.245115741s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.738987138 +0000 UTC m=+3.168565173" lastFinishedPulling="2026-05-26 19:25:47.428644076 +0000 UTC m=+20.858222118" observedRunningTime="2026-05-26 19:25:48.244955164 +0000 UTC m=+21.674533212" watchObservedRunningTime="2026-05-26 19:25:48.245115741 +0000 UTC m=+21.674693791"
May 26 19:25:49.098125 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.098090    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:49.098328 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.098109    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:49.098328 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:49.098226    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:49.098328 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:49.098295    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:49.185718 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.185482    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 19:25:49.191956 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.191926    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h" event={"ID":"f41ccf5d-8426-40d9-965a-04315c04393b","Type":"ContainerStarted","Data":"248455bccd53198b374250d1ac63bcdfad9c7001fcc219a20b4cd32d43e86894"}
May 26 19:25:49.193321 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.193299    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bnv2p" event={"ID":"31830eb0-3134-4d8f-84e2-24a6b8747308","Type":"ContainerStarted","Data":"1e78725b93206372a76b20075bb49e120eb95b0aa8ba58f6db5be818ea214d12"}
May 26 19:25:49.196092 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.196041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:25:49.196499 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.196482    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"edbd25867b06d2f56195a0b2b1501975164abf5851ee95891949eca3b20aa8fc"}
May 26 19:25:49.216414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:49.216373    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bnv2p" podStartSLOduration=4.447319573 podStartE2EDuration="22.216357992s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.73975025 +0000 UTC m=+3.169328293" lastFinishedPulling="2026-05-26 19:25:47.508788671 +0000 UTC m=+20.938366712" observedRunningTime="2026-05-26 19:25:49.215697564 +0000 UTC m=+22.645275615" watchObservedRunningTime="2026-05-26 19:25:49.216357992 +0000 UTC m=+22.645936047"
May 26 19:25:50.098820 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:50.098790    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:50.099042 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:50.098891    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:50.115313 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:50.115215    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:25:49.185711192Z","UUID":"cc0f0fc1-2b68-4976-93d3-3ffa5571457e","Handler":null,"Name":"","Endpoint":""}
May 26 19:25:50.118066 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:50.118045    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 19:25:50.118179 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:50.118074    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 19:25:51.100964 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:51.100933    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:51.101470 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:51.100933    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:51.101470 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:51.101038    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:51.101470 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:51.101104    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:51.202373 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:51.202348    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:25:51.202700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:51.202678    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"e0bebb8f1e2b818a550ecafcb4efd89969851881d979733eed81c09fecef9db4"}
May 26 19:25:51.204191 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:51.204166    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h" event={"ID":"f41ccf5d-8426-40d9-965a-04315c04393b","Type":"ContainerStarted","Data":"bb15f76d5de353fb950afcb9bc9ecd271b17f7ee1e6ef89c43070289dc713801"}
May 26 19:25:52.098586 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:52.098562    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:52.098740 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:52.098653    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:52.134478 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:52.134447    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:52.135066 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:52.134622    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:25:52.135066 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:52.134695    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret podName:264b0107-4c8f-41a3-8b40-ec3500becd40 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:08.13467567 +0000 UTC m=+41.564253702 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret") pod "global-pull-secret-syncer-sm7r5" (UID: "264b0107-4c8f-41a3-8b40-ec3500becd40") : object "kube-system"/"original-pull-secret" not registered
May 26 19:25:52.261611 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:52.261573    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:52.262274 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:52.262253    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:52.278925 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:52.278885    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kh82h" podStartSLOduration=4.631860983 podStartE2EDuration="25.278871876s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.745996312 +0000 UTC m=+3.175574342" lastFinishedPulling="2026-05-26 19:25:50.393007192 +0000 UTC m=+23.822585235" observedRunningTime="2026-05-26 19:25:51.222614432 +0000 UTC m=+24.652192482" watchObservedRunningTime="2026-05-26 19:25:52.278871876 +0000 UTC m=+25.708449937"
May 26 19:25:53.101673 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.101519    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:53.101792 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.101519    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:53.101792 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:53.101769    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:53.101919 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:53.101893    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:53.212911 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.212880    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerStarted","Data":"fd528fc0421cdd1732bcd4fe62c87cfb9a3e7593b0760a55dd3c47836f6adfb8"}
May 26 19:25:53.217107 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.217082    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:25:53.217806 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.217477    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"07e2932d7c831ce40d5f98abc15a57583222a9ecfc22e14233e7291eac9cb547"}
May 26 19:25:53.218008 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.217991    2576 scope.go:117] "RemoveContainer" containerID="33be5deffc7c55a379aea30ca2da0c15cba16d0ff8b4d4e55ba9a6d246514a9c"
May 26 19:25:53.381584 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:53.381563    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:54.098573 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.098508    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:54.098731 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:54.098662    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:54.220436 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.220406    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="fd528fc0421cdd1732bcd4fe62c87cfb9a3e7593b0760a55dd3c47836f6adfb8" exitCode=0
May 26 19:25:54.220976 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.220493    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"fd528fc0421cdd1732bcd4fe62c87cfb9a3e7593b0760a55dd3c47836f6adfb8"}
May 26 19:25:54.223700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.223671    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:25:54.224238 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.224219    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" event={"ID":"be6699f4-6705-4491-9ab4-da6905a6e96a","Type":"ContainerStarted","Data":"b514a372f6047ab60cdc47cfeab05e4cf28657d8b6dc0703d4e51fe89063efe0"}
May 26 19:25:54.224573 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.224549    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:54.224573 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.224577    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:54.240591 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.240519    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:54.246009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.245987    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:25:54.272659 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:54.272612    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8" podStartSLOduration=9.467420448 podStartE2EDuration="27.272598497s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.73701864 +0000 UTC m=+3.166596669" lastFinishedPulling="2026-05-26 19:25:47.542196676 +0000 UTC m=+20.971774718" observedRunningTime="2026-05-26 19:25:54.27202376 +0000 UTC m=+27.701601823" watchObservedRunningTime="2026-05-26 19:25:54.272598497 +0000 UTC m=+27.702176546"
May 26 19:25:55.045563 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.045510    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sm7r5"]
May 26 19:25:55.045687 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.045676    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:55.045813 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:55.045784    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:55.046976 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.046950    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-th4nh"]
May 26 19:25:55.047085 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.047072    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:55.047640 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:55.047166    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:55.056667 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.056646    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbzzm"]
May 26 19:25:55.056785 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.056772    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:55.056892 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:55.056874    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:55.227801 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.227765    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="e03b812e2f323ca6d4415e1e6898654e2d753c1898a97028b9c5a1269bf090ca" exitCode=0
May 26 19:25:55.228229 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:55.227858    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"e03b812e2f323ca6d4415e1e6898654e2d753c1898a97028b9c5a1269bf090ca"}
May 26 19:25:56.232039 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:56.231949    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="51615f9fc284594380a0afed04fff85e8f2a8f3765f1b1e5f6bbee8a3f6a0ebf" exitCode=0
May 26 19:25:56.232394 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:56.232035    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"51615f9fc284594380a0afed04fff85e8f2a8f3765f1b1e5f6bbee8a3f6a0ebf"}
May 26 19:25:57.099087 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:57.099041    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:57.099215 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:57.099163    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:25:57.099321 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:57.099298    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:57.099387 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:57.099364    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:57.099479 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:57.099456    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:57.099588 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:57.099568    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:58.401619 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:58.401582    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:58.402162 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:58.401736    2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 19:25:58.402277 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:58.402257    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dqjc5"
May 26 19:25:59.098028 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:59.097994    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:25:59.098191 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:59.097997    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:25:59.098191 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:59.098132    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:25:59.098191 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:25:59.098004    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:25:59.098191 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:59.098161    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:25:59.098404 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:25:59.098236    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:26:00.795892 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:00.795853    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:00.795920    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796030    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796038    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796065    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796080    2576 projected.go:194] Error preparing data for projected volume kube-api-access-j662r for pod openshift-network-diagnostics/network-check-target-th4nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796097    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:32.796081267 +0000 UTC m=+66.225659298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:26:00.796402 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:00.796131    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r podName:986f5da4-9255-4cbc-9457-c5af708772e2 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:32.796115502 +0000 UTC m=+66.225693529 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j662r" (UniqueName: "kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r") pod "network-check-target-th4nh" (UID: "986f5da4-9255-4cbc-9457-c5af708772e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:26:01.101165 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.101139    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:26:01.101316 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.101141    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:26:01.101316 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.101258    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sm7r5" podUID="264b0107-4c8f-41a3-8b40-ec3500becd40"
May 26 19:26:01.101430 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.101339    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:26:01.101430 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.101141    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:01.101430 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.101424    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-th4nh" podUID="986f5da4-9255-4cbc-9457-c5af708772e2"
May 26 19:26:01.421078 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.421052    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-143-77.ec2.internal" event="NodeReady"
May 26 19:26:01.421261 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.421181    2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 19:26:01.453700 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.453670    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"]
May 26 19:26:01.458038 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.458007    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:26:01.458694 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.458663    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"
May 26 19:26:01.461440 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.461388    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:26:01.461440 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.461422    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:26:01.461640 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.461524    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wljgc\""
May 26 19:26:01.462557 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.462520    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"]
May 26 19:26:01.462657 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.462638    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.465453 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465011    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 19:26:01.465453 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465055    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 19:26:01.465453 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465080    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dljqb\""
May 26 19:26:01.465453 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465296    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 19:26:01.465453 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465386    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"]
May 26 19:26:01.465772 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.465589    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.467743 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.467725    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 26 19:26:01.468756 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.468009    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 26 19:26:01.468756 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.468483    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"]
May 26 19:26:01.468896 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.468879    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.470123 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.469551    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 26 19:26:01.470479 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.469633    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 26 19:26:01.470664 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.470647    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dpfb9\""
May 26 19:26:01.472362 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.472207    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 19:26:01.472458 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.472444    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"]
May 26 19:26:01.472514 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.472465    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wk6bq\""
May 26 19:26:01.472848 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.472678    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 19:26:01.472973 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.472955    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.473119 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.473096    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 19:26:01.475846 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.475426    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 26 19:26:01.475948 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.475911    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 26 19:26:01.476999 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.476548    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 26 19:26:01.476999 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.476734    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 26 19:26:01.478762 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.477352    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"]
May 26 19:26:01.478762 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.477379    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xf7v8"]
May 26 19:26:01.479801 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.479774    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.483556 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.482792    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 26 19:26:01.485188 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.485129    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"]
May 26 19:26:01.485188 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.485156    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"]
May 26 19:26:01.485188 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.485169    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"]
May 26 19:26:01.485374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.485258    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.485502 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.485484    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:26:01.486420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.486400    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"]
May 26 19:26:01.487201 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.487182    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2v"]
May 26 19:26:01.487586 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.487568    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 19:26:01.487676 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.487642    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 19:26:01.487676 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.487651    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\""
May 26 19:26:01.490469 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.490449    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.492862 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.492845    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 19:26:01.493179 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.493160    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 19:26:01.493179 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.493171    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 19:26:01.493323 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.493220    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\""
May 26 19:26:01.499854 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.498949    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2v"]
May 26 19:26:01.499854 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.499432    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xf7v8"]
May 26 19:26:01.603149 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.603312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.603312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603189    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca45bbf1-bb48-4069-9536-fce59272c65c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.603312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c9zn\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.603312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfskq\" (UniqueName: \"kubernetes.io/projected/9ca736ac-5101-4ea1-aa84-50e460d1de32-kube-api-access-bfskq\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.603312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ca736ac-5101-4ea1-aa84-50e460d1de32-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603349    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603382    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7ctr\" (UniqueName: \"kubernetes.io/projected/7d306ecf-acb7-4086-bada-412aabdec97d-kube-api-access-k7ctr\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d306ecf-acb7-4086-bada-412aabdec97d-tmp-dir\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603466    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.603560 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szw5h\" (UniqueName: \"kubernetes.io/projected/ca45bbf1-bb48-4069-9536-fce59272c65c-kube-api-access-szw5h\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjtpg\" (UniqueName: \"kubernetes.io/projected/1398705e-a375-4623-99c0-a54eef05a07f-kube-api-access-kjtpg\") pod \"network-check-source-7f44b6dd87-x4mb5\" (UID: \"1398705e-a375-4623-99c0-a54eef05a07f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bce422a-412b-4059-8819-cb18623ba19e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d306ecf-acb7-4086-bada-412aabdec97d-config-volume\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckw2f\" (UniqueName: \"kubernetes.io/projected/2453915b-ca88-440b-8f04-82378382f88d-kube-api-access-ckw2f\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.603884 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603852    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/014c64fb-b987-45e4-92cc-4d664df6703f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca736ac-5101-4ea1-aa84-50e460d1de32-tmp\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.603979    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.604058    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.604085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.604108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvfrn\" (UniqueName: \"kubernetes.io/projected/014c64fb-b987-45e4-92cc-4d664df6703f-kube-api-access-cvfrn\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.604195 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.604132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705561 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705465    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.705561 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705506    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705561 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705548    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvfrn\" (UniqueName: \"kubernetes.io/projected/014c64fb-b987-45e4-92cc-4d664df6703f-kube-api-access-cvfrn\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705576    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705603    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705628    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705652    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca45bbf1-bb48-4069-9536-fce59272c65c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705677    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5c9zn\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705702    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bfskq\" (UniqueName: \"kubernetes.io/projected/9ca736ac-5101-4ea1-aa84-50e460d1de32-kube-api-access-bfskq\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705728    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ca736ac-5101-4ea1-aa84-50e460d1de32-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.705741    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705754    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705781    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.705837 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.705814    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:02.205791422 +0000 UTC m=+35.635369465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705840    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705875    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k7ctr\" (UniqueName: \"kubernetes.io/projected/7d306ecf-acb7-4086-bada-412aabdec97d-kube-api-access-k7ctr\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705909    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d306ecf-acb7-4086-bada-412aabdec97d-tmp-dir\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705943    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705967    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.705998    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szw5h\" (UniqueName: \"kubernetes.io/projected/ca45bbf1-bb48-4069-9536-fce59272c65c-kube-api-access-szw5h\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.706037    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.706134    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.706172    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:02.20615848 +0000 UTC m=+35.635736508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:01.706384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.706182    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.706882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.706500    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d306ecf-acb7-4086-bada-412aabdec97d-tmp-dir\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.706882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.706823    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.706993 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.706975    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:01.706993 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.706991    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:01.707105 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.707003    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:01.707105 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.707037    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:02.207019957 +0000 UTC m=+35.636597987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:01.707105 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:01.707053    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:02.207044879 +0000 UTC m=+35.636622911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:01.707247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707126    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.707247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707202    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjtpg\" (UniqueName: \"kubernetes.io/projected/1398705e-a375-4623-99c0-a54eef05a07f-kube-api-access-kjtpg\") pod \"network-check-source-7f44b6dd87-x4mb5\" (UID: \"1398705e-a375-4623-99c0-a54eef05a07f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"
May 26 19:26:01.707247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707242    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.707374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707269    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bce422a-412b-4059-8819-cb18623ba19e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.707374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707285    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d306ecf-acb7-4086-bada-412aabdec97d-config-volume\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.707374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707307    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ckw2f\" (UniqueName: \"kubernetes.io/projected/2453915b-ca88-440b-8f04-82378382f88d-kube-api-access-ckw2f\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.707374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707338    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/014c64fb-b987-45e4-92cc-4d664df6703f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.707374 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707365    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca736ac-5101-4ea1-aa84-50e460d1de32-tmp\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.707647 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707394    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.707647 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707449    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.707997 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.707974    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5bce422a-412b-4059-8819-cb18623ba19e-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:01.708098 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.708072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/014c64fb-b987-45e4-92cc-4d664df6703f-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.708179 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.708158    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ca736ac-5101-4ea1-aa84-50e460d1de32-tmp\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.708627 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.708600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7d306ecf-acb7-4086-bada-412aabdec97d-config-volume\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.711727 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.710965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-ca\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.711727 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.711247    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.711727 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.711280    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.711727 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.711687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ca736ac-5101-4ea1-aa84-50e460d1de32-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.711984 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.711872    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca45bbf1-bb48-4069-9536-fce59272c65c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.712775 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.712743    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.712775 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.712758    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.712951 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.712777    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/014c64fb-b987-45e4-92cc-4d664df6703f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.715137 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.715115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7ctr\" (UniqueName: \"kubernetes.io/projected/7d306ecf-acb7-4086-bada-412aabdec97d-kube-api-access-k7ctr\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:01.715246 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.715204    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvfrn\" (UniqueName: \"kubernetes.io/projected/014c64fb-b987-45e4-92cc-4d664df6703f-kube-api-access-cvfrn\") pod \"cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj\" (UID: \"014c64fb-b987-45e4-92cc-4d664df6703f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.716075 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.715884    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szw5h\" (UniqueName: \"kubernetes.io/projected/ca45bbf1-bb48-4069-9536-fce59272c65c-kube-api-access-szw5h\") pod \"managed-serviceaccount-addon-agent-77fc4878d-phtf2\" (UID: \"ca45bbf1-bb48-4069-9536-fce59272c65c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.716339 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.716190    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfskq\" (UniqueName: \"kubernetes.io/projected/9ca736ac-5101-4ea1-aa84-50e460d1de32-kube-api-access-bfskq\") pod \"klusterlet-addon-workmgr-6bb5df74f-2l74j\" (UID: \"9ca736ac-5101-4ea1-aa84-50e460d1de32\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:01.717041 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.717002    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjtpg\" (UniqueName: \"kubernetes.io/projected/1398705e-a375-4623-99c0-a54eef05a07f-kube-api-access-kjtpg\") pod \"network-check-source-7f44b6dd87-x4mb5\" (UID: \"1398705e-a375-4623-99c0-a54eef05a07f\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"
May 26 19:26:01.717390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.717365    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckw2f\" (UniqueName: \"kubernetes.io/projected/2453915b-ca88-440b-8f04-82378382f88d-kube-api-access-ckw2f\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:01.717678 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.717654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.718761 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.718744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c9zn\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:01.773505 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.773464    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"
May 26 19:26:01.799612 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.799584    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"
May 26 19:26:01.814567 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.814526    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:26:01.832393 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:01.832366    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:02.212223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:02.212169    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:02.212236    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:02.212281    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212339    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212350    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212369    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:02.212390    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:02.212418 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212422    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:03.212400005 +0000 UTC m=+36.641978041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:02.212865 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212437    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:02.212865 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212455    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:02.212865 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212497    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:03.212464369 +0000 UTC m=+36.642042402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:02.212865 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212542    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:03.212516061 +0000 UTC m=+36.642094096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:02.212865 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:02.212567    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:03.212557706 +0000 UTC m=+36.642135740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:03.098733 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.098700    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:26:03.098733 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.098722    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:03.099270 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.098700    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:26:03.102334 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.102306    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:26:03.102467 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.102363    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 19:26:03.102467 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.102375    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\""
May 26 19:26:03.102467 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.102451    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\""
May 26 19:26:03.221933 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.221900    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:03.222098 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.221941    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:03.222098 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.221969    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:03.222098 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222051    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:03.222098 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222054    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:03.222098 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222077    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:03.222325 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222052    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:03.222325 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222111    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:05.222092235 +0000 UTC m=+38.651670263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:03.222325 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222185    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:05.222162072 +0000 UTC m=+38.651740112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:03.222325 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222217    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:05.22220669 +0000 UTC m=+38.651784722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:03.222325 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.222313    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:03.222521 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222404    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:03.222521 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:03.222444    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:05.222432293 +0000 UTC m=+38.652010321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:03.454264 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.454194    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5"]
May 26 19:26:03.455188 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.455154    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"]
May 26 19:26:03.457802 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.457780    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"]
May 26 19:26:03.460693 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:03.460645    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1398705e_a375_4623_99c0_a54eef05a07f.slice/crio-38117b3b60bae020f4ca8200bdeacbd7f433f34948891fe10d9dbcb6bf5b8979 WatchSource:0}: Error finding container 38117b3b60bae020f4ca8200bdeacbd7f433f34948891fe10d9dbcb6bf5b8979: Status 404 returned error can't find the container with id 38117b3b60bae020f4ca8200bdeacbd7f433f34948891fe10d9dbcb6bf5b8979
May 26 19:26:03.461215 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:03.461188    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca736ac_5101_4ea1_aa84_50e460d1de32.slice/crio-05eef5e832f066b669b691135895e778e7e049855643f872efe13ec7a2631bc4 WatchSource:0}: Error finding container 05eef5e832f066b669b691135895e778e7e049855643f872efe13ec7a2631bc4: Status 404 returned error can't find the container with id 05eef5e832f066b669b691135895e778e7e049855643f872efe13ec7a2631bc4
May 26 19:26:03.461835 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:03.461811    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod014c64fb_b987_45e4_92cc_4d664df6703f.slice/crio-5c7171afdc89ade034edad3ce399eef545ca54bd520ad69047222b3e00cacbb5 WatchSource:0}: Error finding container 5c7171afdc89ade034edad3ce399eef545ca54bd520ad69047222b3e00cacbb5: Status 404 returned error can't find the container with id 5c7171afdc89ade034edad3ce399eef545ca54bd520ad69047222b3e00cacbb5
May 26 19:26:03.465703 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:03.465664    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2"]
May 26 19:26:03.469420 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:03.469387    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca45bbf1_bb48_4069_9536_fce59272c65c.slice/crio-dbbcf8f89096d8e3b674907ad074f3ad3c76f365b5dd517be4ee8966eda1e33b WatchSource:0}: Error finding container dbbcf8f89096d8e3b674907ad074f3ad3c76f365b5dd517be4ee8966eda1e33b: Status 404 returned error can't find the container with id dbbcf8f89096d8e3b674907ad074f3ad3c76f365b5dd517be4ee8966eda1e33b
May 26 19:26:04.246764 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.246724    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerStarted","Data":"05eef5e832f066b669b691135895e778e7e049855643f872efe13ec7a2631bc4"}
May 26 19:26:04.247893 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.247861    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerStarted","Data":"5c7171afdc89ade034edad3ce399eef545ca54bd520ad69047222b3e00cacbb5"}
May 26 19:26:04.248989 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.248965    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5" event={"ID":"1398705e-a375-4623-99c0-a54eef05a07f","Type":"ContainerStarted","Data":"38117b3b60bae020f4ca8200bdeacbd7f433f34948891fe10d9dbcb6bf5b8979"}
May 26 19:26:04.251732 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.251654    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="e6f77e9744bc3d9b6395bc944112183fe73c7b2bb0edd136541b1b5e40c0f6d4" exitCode=0
May 26 19:26:04.251732 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.251689    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"e6f77e9744bc3d9b6395bc944112183fe73c7b2bb0edd136541b1b5e40c0f6d4"}
May 26 19:26:04.252819 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:04.252796    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2" event={"ID":"ca45bbf1-bb48-4069-9536-fce59272c65c","Type":"ContainerStarted","Data":"dbbcf8f89096d8e3b674907ad074f3ad3c76f365b5dd517be4ee8966eda1e33b"}
May 26 19:26:05.240811 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.240769    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:05.241009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.240838    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:05.241009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.240878    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:05.241009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.240916    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:05.241009 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.240964    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241043    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.241020383 +0000 UTC m=+42.670598413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241056    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241107    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.241090438 +0000 UTC m=+42.670668474 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241164    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241195    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.241184102 +0000 UTC m=+42.670762137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241256    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:05.241267 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241268    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:05.241597 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:05.241299    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:09.241288428 +0000 UTC m=+42.670866462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:05.259118 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.259085    2576 generic.go:358] "Generic (PLEG): container finished" podID="1f50beb4-cbef-4380-9e29-5e36b07bae3e" containerID="36254423cd974cc588986ac9b289dc215fe7b24b4ed6405558db31165efc9cc0" exitCode=0
May 26 19:26:05.259585 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:05.259138    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerDied","Data":"36254423cd974cc588986ac9b289dc215fe7b24b4ed6405558db31165efc9cc0"}
May 26 19:26:06.266516 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:06.266465    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" event={"ID":"1f50beb4-cbef-4380-9e29-5e36b07bae3e","Type":"ContainerStarted","Data":"01e479f0110521001cb48944b691eaa1c92499915ca206314a5c15dfae2f0f24"}
May 26 19:26:06.289323 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:06.289264    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tj5wx" podStartSLOduration=5.567408664 podStartE2EDuration="39.289243018s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:25:29.742445633 +0000 UTC m=+3.172023664" lastFinishedPulling="2026-05-26 19:26:03.464279979 +0000 UTC m=+36.893858018" observedRunningTime="2026-05-26 19:26:06.287777068 +0000 UTC m=+39.717355121" watchObservedRunningTime="2026-05-26 19:26:06.289243018 +0000 UTC m=+39.718821069"
May 26 19:26:08.169847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:08.169806    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:26:08.174073 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:08.174046    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/264b0107-4c8f-41a3-8b40-ec3500becd40-original-pull-secret\") pod \"global-pull-secret-syncer-sm7r5\" (UID: \"264b0107-4c8f-41a3-8b40-ec3500becd40\") " pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:26:08.211906 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:08.211873    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sm7r5"
May 26 19:26:09.277440 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:09.277406    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:09.277470    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:09.277513    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:09.277563    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277575    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277594    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277636    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277654    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277676    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277653    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.277632945 +0000 UTC m=+50.707210987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277709    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.277690266 +0000 UTC m=+50.707268294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277732    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.277721648 +0000 UTC m=+50.707299681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:09.277832 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:09.277750    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:17.277739273 +0000 UTC m=+50.707317301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:11.170068 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:11.170039    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sm7r5"]
May 26 19:26:11.173120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:11.173091    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264b0107_4c8f_41a3_8b40_ec3500becd40.slice/crio-a836f8ac4e242bd2dc9abffb7524d34993d7138e5b947fb433a0824de6870f57 WatchSource:0}: Error finding container a836f8ac4e242bd2dc9abffb7524d34993d7138e5b947fb433a0824de6870f57: Status 404 returned error can't find the container with id a836f8ac4e242bd2dc9abffb7524d34993d7138e5b947fb433a0824de6870f57
May 26 19:26:11.278849 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:11.278810    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerStarted","Data":"f05e356d32761bcc878e1b17026aa8f430a6b4f19ba6f1c696fa68b7c80b9088"}
May 26 19:26:11.280187 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:11.280159    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5" event={"ID":"1398705e-a375-4623-99c0-a54eef05a07f","Type":"ContainerStarted","Data":"a69767ef6569dcea1fc118d023f7221f156ad3aa5ce98b4a80028622b174abf2"}
May 26 19:26:11.281166 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:11.281142    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sm7r5" event={"ID":"264b0107-4c8f-41a3-8b40-ec3500becd40","Type":"ContainerStarted","Data":"a836f8ac4e242bd2dc9abffb7524d34993d7138e5b947fb433a0824de6870f57"}
May 26 19:26:11.295541 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:11.295484    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x4mb5" podStartSLOduration=34.699973035 podStartE2EDuration="42.295473413s" podCreationTimestamp="2026-05-26 19:25:29 +0000 UTC" firstStartedPulling="2026-05-26 19:26:03.463228001 +0000 UTC m=+36.892806030" lastFinishedPulling="2026-05-26 19:26:11.05872838 +0000 UTC m=+44.488306408" observedRunningTime="2026-05-26 19:26:11.294634951 +0000 UTC m=+44.724213002" watchObservedRunningTime="2026-05-26 19:26:11.295473413 +0000 UTC m=+44.725051463"
May 26 19:26:16.294625 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:16.294571    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sm7r5" event={"ID":"264b0107-4c8f-41a3-8b40-ec3500becd40","Type":"ContainerStarted","Data":"355a08eaebf1a488602545a41eccd288e7bacbb1f388f8bfcf117517b23cf77f"}
May 26 19:26:17.312458 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:17.312413    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sm7r5" podStartSLOduration=36.354560067 podStartE2EDuration="41.312395054s" podCreationTimestamp="2026-05-26 19:25:36 +0000 UTC" firstStartedPulling="2026-05-26 19:26:11.174770917 +0000 UTC m=+44.604348951" lastFinishedPulling="2026-05-26 19:26:16.13260591 +0000 UTC m=+49.562183938" observedRunningTime="2026-05-26 19:26:17.311577135 +0000 UTC m=+50.741155184" watchObservedRunningTime="2026-05-26 19:26:17.312395054 +0000 UTC m=+50.741973104"
May 26 19:26:17.352112 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:17.352071    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:17.352259 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:17.352199    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:17.352259 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352229    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:17.352259 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:17.352243    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:17.352401 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:17.352279    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:17.352401 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352326    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:33.352303672 +0000 UTC m=+66.781881703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:17.352401 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352394    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352407    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352433    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352452    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:26:33.35243755 +0000 UTC m=+66.782015581 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352497    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:26:33.352483209 +0000 UTC m=+66.782061257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352433    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:17.352553 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:17.352552    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:26:33.352541441 +0000 UTC m=+66.782119495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:19.302079 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.302049    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerStarted","Data":"49873261cadbda239ce3293cb937030348bd8e2ef12a9edc338a22bac1d8c0a1"}
May 26 19:26:19.302432 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.302242    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:19.303982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.303961    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:26:19.304079 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.303995    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerStarted","Data":"1a33ca0fc6e7f1f94be9fc36770b321c3827f48620903a00efc2eef67d7fc97a"}
May 26 19:26:19.304079 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.304016    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerStarted","Data":"e72e79a6ef601125c64707df63f67e8e7e9b6a6cd181dab6d5c13a8a0c43e602"}
May 26 19:26:19.320624 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:19.320517    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" podStartSLOduration=14.692465539 podStartE2EDuration="30.320503845s" podCreationTimestamp="2026-05-26 19:25:49 +0000 UTC" firstStartedPulling="2026-05-26 19:26:03.463381128 +0000 UTC m=+36.892959167" lastFinishedPulling="2026-05-26 19:26:19.09141944 +0000 UTC m=+52.520997473" observedRunningTime="2026-05-26 19:26:19.316319295 +0000 UTC m=+52.745897345" watchObservedRunningTime="2026-05-26 19:26:19.320503845 +0000 UTC m=+52.750081896"
May 26 19:26:20.325312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:20.325264    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" podStartSLOduration=15.714908303 podStartE2EDuration="31.325239432s" podCreationTimestamp="2026-05-26 19:25:49 +0000 UTC" firstStartedPulling="2026-05-26 19:26:03.464298275 +0000 UTC m=+36.893876312" lastFinishedPulling="2026-05-26 19:26:19.07462941 +0000 UTC m=+52.504207441" observedRunningTime="2026-05-26 19:26:20.323906948 +0000 UTC m=+53.753485017" watchObservedRunningTime="2026-05-26 19:26:20.325239432 +0000 UTC m=+53.754817482"
May 26 19:26:26.242774 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:26.242746    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-shbc8"
May 26 19:26:32.878810 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:32.878759    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:32.879245 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:32.878906    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:26:32.881565 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:32.881520    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j662r\" (UniqueName: \"kubernetes.io/projected/986f5da4-9255-4cbc-9457-c5af708772e2-kube-api-access-j662r\") pod \"network-check-target-th4nh\" (UID: \"986f5da4-9255-4cbc-9457-c5af708772e2\") " pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:32.881676 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:32.881615    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:26:32.889968 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:32.889945    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:26:32.890080 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:32.890009    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:36.889988837 +0000 UTC m=+130.319566880 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : secret "metrics-daemon-secret" not found
May 26 19:26:33.121208 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.121176    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9g26n\""
May 26 19:26:33.129326 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.129267    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:33.248095 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.248058    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-th4nh"]
May 26 19:26:33.250706 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:26:33.250678    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986f5da4_9255_4cbc_9457_c5af708772e2.slice/crio-effa635440a9987ebc1aa9ab4aab340dcce9de796f864996948d7ce2ade7d802 WatchSource:0}: Error finding container effa635440a9987ebc1aa9ab4aab340dcce9de796f864996948d7ce2ade7d802: Status 404 returned error can't find the container with id effa635440a9987ebc1aa9ab4aab340dcce9de796f864996948d7ce2ade7d802
May 26 19:26:33.344481 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.344447    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-th4nh" event={"ID":"986f5da4-9255-4cbc-9457-c5af708772e2","Type":"ContainerStarted","Data":"c5011817dd05ccaeb11edc9787d3cd611f31ae743bae6b9b694e5b7cb54b75bf"}
May 26 19:26:33.344640 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.344490    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-th4nh" event={"ID":"986f5da4-9255-4cbc-9457-c5af708772e2","Type":"ContainerStarted","Data":"effa635440a9987ebc1aa9ab4aab340dcce9de796f864996948d7ce2ade7d802"}
May 26 19:26:33.344640 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.344562    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:26:33.359608 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.359570    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-th4nh" podStartSLOduration=66.359557077 podStartE2EDuration="1m6.359557077s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:26:33.358880679 +0000 UTC m=+66.788458760" watchObservedRunningTime="2026-05-26 19:26:33.359557077 +0000 UTC m=+66.789135123"
May 26 19:26:33.382491 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.382429    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:26:33.382631 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.382468    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:26:33.382631 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382586    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:26:33.382631 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382604    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382634    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382648    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:27:05.382634985 +0000 UTC m=+98.812213013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.382591    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382673    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382683    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:27:05.382667404 +0000 UTC m=+98.812245447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382731    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:27:05.382720738 +0000 UTC m=+98.812298769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:26:33.382764 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:33.382748    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:26:33.383004 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382815    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:26:33.383004 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:26:33.382840    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:27:05.382833975 +0000 UTC m=+98.812412003 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:26:50.384187 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:50.384147    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2" event={"ID":"ca45bbf1-bb48-4069-9536-fce59272c65c","Type":"ContainerStarted","Data":"09ab9c2f9338aaabac009d27a71c22f63c2234e0726c72053f584d87a460387c"}
May 26 19:26:50.399072 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:26:50.399023    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2" podStartSLOduration=15.471698815 podStartE2EDuration="1m1.399009613s" podCreationTimestamp="2026-05-26 19:25:49 +0000 UTC" firstStartedPulling="2026-05-26 19:26:03.471918172 +0000 UTC m=+36.901496213" lastFinishedPulling="2026-05-26 19:26:49.399228971 +0000 UTC m=+82.828807011" observedRunningTime="2026-05-26 19:26:50.398250382 +0000 UTC m=+83.827828435" watchObservedRunningTime="2026-05-26 19:26:50.399009613 +0000 UTC m=+83.828587662"
May 26 19:27:04.349728 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:04.349698    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-th4nh"
May 26 19:27:05.426839 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:05.426801    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:05.426846    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:05.426890    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:05.426917    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.426942    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.426960    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.426995    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427007    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427014    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:09.426998745 +0000 UTC m=+162.856576773 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427026    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427048    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:09.427035851 +0000 UTC m=+162.856613879 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427063    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:09.427056769 +0000 UTC m=+162.856634797 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:27:05.427223 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:05.427088    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:28:09.427072294 +0000 UTC m=+162.856650325 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:27:36.964579 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:27:36.964517    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:27:36.965157 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:36.964685    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:27:36.965157 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:27:36.964773    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs podName:cceaa09b-1667-44ab-8040-c817956ce806 nodeName:}" failed. No retries permitted until 2026-05-26 19:29:38.964751204 +0000 UTC m=+252.394329239 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs") pod "network-metrics-daemon-qbzzm" (UID: "cceaa09b-1667-44ab-8040-c817956ce806") : secret "metrics-daemon-secret" not found
May 26 19:28:02.950067 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:02.950034    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsvbh_73bfe9d1-d934-4450-8d01-2c074d6d307b/dns-node-resolver/0.log"
May 26 19:28:03.949890 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:03.949862    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8452_9f1a8f1e-67b3-46ab-83b1-734f37eff620/node-ca/0.log"
May 26 19:28:04.484040 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:04.483995    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8"
May 26 19:28:04.508277 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:04.508247    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd" podUID="5bce422a-412b-4059-8819-cb18623ba19e"
May 26 19:28:04.539608 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:04.539576    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xf7v8" podUID="7d306ecf-acb7-4086-bada-412aabdec97d"
May 26 19:28:04.545709 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:04.545681    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ssq2v" podUID="2453915b-ca88-440b-8f04-82378382f88d"
May 26 19:28:04.560587 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:04.560559    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:28:04.560587 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:04.560581    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:28:04.560761 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:04.560569    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf7v8"
May 26 19:28:04.560761 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:04.560569    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:28:06.125005 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:06.124922    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qbzzm" podUID="cceaa09b-1667-44ab-8040-c817956ce806"
May 26 19:28:09.513569 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:09.513517    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:09.513633    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513674    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513732    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513752    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert podName:2453915b-ca88-440b-8f04-82378382f88d nodeName:}" failed. No retries permitted until 2026-05-26 19:30:11.513733102 +0000 UTC m=+284.943311142 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert") pod "ingress-canary-ssq2v" (UID: "2453915b-ca88-440b-8f04-82378382f88d") : secret "canary-serving-cert" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:09.513673    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513785    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls podName:7d306ecf-acb7-4086-bada-412aabdec97d nodeName:}" failed. No retries permitted until 2026-05-26 19:30:11.513773871 +0000 UTC m=+284.943351902 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls") pod "dns-default-xf7v8" (UID: "7d306ecf-acb7-4086-bada-412aabdec97d") : secret "dns-default-metrics-tls" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513808    2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:09.513819    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513876    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert podName:5bce422a-412b-4059-8819-cb18623ba19e nodeName:}" failed. No retries permitted until 2026-05-26 19:30:11.513860487 +0000 UTC m=+284.943438515 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-cchcd" (UID: "5bce422a-412b-4059-8819-cb18623ba19e") : secret "networking-console-plugin-cert" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513901    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513912    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc7f4564-knmnt: secret "image-registry-tls" not found
May 26 19:28:09.513977 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:09.513948    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls podName:71d2b243-bf92-43be-9c2b-6146e8c0c3a8 nodeName:}" failed. No retries permitted until 2026-05-26 19:30:11.513938875 +0000 UTC m=+284.943516903 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls") pod "image-registry-fc7f4564-knmnt" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8") : secret "image-registry-tls" not found
May 26 19:28:14.198497 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.198466    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x978b"]
May 26 19:28:14.201362 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.201330    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.203739 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.203713    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 19:28:14.203871 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.203792    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 19:28:14.204661 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.204640    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 19:28:14.204770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.204648    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvgwn\""
May 26 19:28:14.204770 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.204669    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 19:28:14.210978 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.210955    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x978b"]
May 26 19:28:14.356421 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.356387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.356421 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.356424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/971a2561-3b75-47c2-afa4-0cc832cd708d-data-volume\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.356662 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.356448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndbn9\" (UniqueName: \"kubernetes.io/projected/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-api-access-ndbn9\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.356662 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.356563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/971a2561-3b75-47c2-afa4-0cc832cd708d-crio-socket\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.356662 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.356590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457736 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457662    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/971a2561-3b75-47c2-afa4-0cc832cd708d-crio-socket\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457736 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457714    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457901 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457787    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457901 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457801    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/971a2561-3b75-47c2-afa4-0cc832cd708d-crio-socket\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457901 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457815    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/971a2561-3b75-47c2-afa4-0cc832cd708d-data-volume\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.457901 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.457874    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ndbn9\" (UniqueName: \"kubernetes.io/projected/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-api-access-ndbn9\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.458067 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:14.457936    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 19:28:14.458067 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:14.458016    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls podName:971a2561-3b75-47c2-afa4-0cc832cd708d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:14.957994954 +0000 UTC m=+168.387572983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x978b" (UID: "971a2561-3b75-47c2-afa4-0cc832cd708d") : secret "insights-runtime-extractor-tls" not found
May 26 19:28:14.458145 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.458108    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/971a2561-3b75-47c2-afa4-0cc832cd708d-data-volume\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.458298 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.458281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.468268 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.468240    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndbn9\" (UniqueName: \"kubernetes.io/projected/971a2561-3b75-47c2-afa4-0cc832cd708d-kube-api-access-ndbn9\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.961947 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:14.961912    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:14.962118 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:14.962060    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 19:28:14.962178 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:14.962167    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls podName:971a2561-3b75-47c2-afa4-0cc832cd708d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:15.962150306 +0000 UTC m=+169.391728334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x978b" (UID: "971a2561-3b75-47c2-afa4-0cc832cd708d") : secret "insights-runtime-extractor-tls" not found
May 26 19:28:15.968829 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:15.968790    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:15.969191 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:15.968923    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 19:28:15.969191 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:15.968988    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls podName:971a2561-3b75-47c2-afa4-0cc832cd708d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:17.968971825 +0000 UTC m=+171.398549853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x978b" (UID: "971a2561-3b75-47c2-afa4-0cc832cd708d") : secret "insights-runtime-extractor-tls" not found
May 26 19:28:17.982007 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:17.981959    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:17.982393 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:17.982078    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 19:28:17.982393 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:17.982142    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls podName:971a2561-3b75-47c2-afa4-0cc832cd708d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:21.982128016 +0000 UTC m=+175.411706044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x978b" (UID: "971a2561-3b75-47c2-afa4-0cc832cd708d") : secret "insights-runtime-extractor-tls" not found
May 26 19:28:18.098781 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:18.098748    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:28:19.595799 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:19.595718    2576 generic.go:358] "Generic (PLEG): container finished" podID="9ca736ac-5101-4ea1-aa84-50e460d1de32" containerID="49873261cadbda239ce3293cb937030348bd8e2ef12a9edc338a22bac1d8c0a1" exitCode=1
May 26 19:28:19.595799 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:19.595776    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerDied","Data":"49873261cadbda239ce3293cb937030348bd8e2ef12a9edc338a22bac1d8c0a1"}
May 26 19:28:19.596186 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:19.596070    2576 scope.go:117] "RemoveContainer" containerID="49873261cadbda239ce3293cb937030348bd8e2ef12a9edc338a22bac1d8c0a1"
May 26 19:28:20.599098 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:20.599063    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerStarted","Data":"a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"}
May 26 19:28:20.599546 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:20.599305    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:28:20.599917 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:20.599902    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:28:22.012668 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:22.012636    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:22.013055 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:22.012803    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 26 19:28:22.013055 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:22.012867    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls podName:971a2561-3b75-47c2-afa4-0cc832cd708d nodeName:}" failed. No retries permitted until 2026-05-26 19:28:30.012849141 +0000 UTC m=+183.442427189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x978b" (UID: "971a2561-3b75-47c2-afa4-0cc832cd708d") : secret "insights-runtime-extractor-tls" not found
May 26 19:28:30.076661 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.076613    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:30.078923 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.078902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/971a2561-3b75-47c2-afa4-0cc832cd708d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x978b\" (UID: \"971a2561-3b75-47c2-afa4-0cc832cd708d\") " pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:30.113558 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.113517    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xvgwn\""
May 26 19:28:30.121587 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.121567    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x978b"
May 26 19:28:30.242913 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.242878    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x978b"]
May 26 19:28:30.245918 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:28:30.245891    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971a2561_3b75_47c2_afa4_0cc832cd708d.slice/crio-a02dafde7117cac61ba8c7039ce4c37da628d9eecbb89dfa03950f118c19d28e WatchSource:0}: Error finding container a02dafde7117cac61ba8c7039ce4c37da628d9eecbb89dfa03950f118c19d28e: Status 404 returned error can't find the container with id a02dafde7117cac61ba8c7039ce4c37da628d9eecbb89dfa03950f118c19d28e
May 26 19:28:30.623582 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.623526    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x978b" event={"ID":"971a2561-3b75-47c2-afa4-0cc832cd708d","Type":"ContainerStarted","Data":"88ef97ec17027f07f8aa583529722a161bb33fd7d62fd64d3ae229f44acdd59d"}
May 26 19:28:30.623582 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:30.623581    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x978b" event={"ID":"971a2561-3b75-47c2-afa4-0cc832cd708d","Type":"ContainerStarted","Data":"a02dafde7117cac61ba8c7039ce4c37da628d9eecbb89dfa03950f118c19d28e"}
May 26 19:28:31.630416 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:31.630382    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x978b" event={"ID":"971a2561-3b75-47c2-afa4-0cc832cd708d","Type":"ContainerStarted","Data":"fa32be99edd3b33ad9305ddaee27c3519a86801a679db7eaed1340b428a62dab"}
May 26 19:28:33.638312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:33.638279    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x978b" event={"ID":"971a2561-3b75-47c2-afa4-0cc832cd708d","Type":"ContainerStarted","Data":"63de69a03591753621c551ac8b92d4fd149124761cd27fc60c6c3f57f54a433b"}
May 26 19:28:33.658635 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:33.658590    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x978b" podStartSLOduration=16.923825488 podStartE2EDuration="19.658574146s" podCreationTimestamp="2026-05-26 19:28:14 +0000 UTC" firstStartedPulling="2026-05-26 19:28:30.298054905 +0000 UTC m=+183.727632937" lastFinishedPulling="2026-05-26 19:28:33.032803565 +0000 UTC m=+186.462381595" observedRunningTime="2026-05-26 19:28:33.657374031 +0000 UTC m=+187.086952081" watchObservedRunningTime="2026-05-26 19:28:33.658574146 +0000 UTC m=+187.088152197"
May 26 19:28:43.424287 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.424255    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fhmvw"]
May 26 19:28:43.428662 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.428644    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.431024 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431001    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 19:28:43.431281 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431265    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 19:28:43.431351 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431283    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 19:28:43.431436 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431418    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 19:28:43.431524 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431509    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 19:28:43.431969 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431954    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 19:28:43.432040 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.431994    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gkhmx\""
May 26 19:28:43.484551 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484515    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-metrics-client-ca\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484655 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484655 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-wtmp\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484655 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484655 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484633    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-accelerators-collector-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484737    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4cgv\" (UniqueName: \"kubernetes.io/projected/f922eee1-8f66-419f-b350-0784ebdf4b47-kube-api-access-t4cgv\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-textfile\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484800    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-root\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.484948 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.484847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-sys\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585775 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585743    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585775 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585781    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-wtmp\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585809    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585836    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-accelerators-collector-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585876    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4cgv\" (UniqueName: \"kubernetes.io/projected/f922eee1-8f66-419f-b350-0784ebdf4b47-kube-api-access-t4cgv\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585902    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-textfile\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585926    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-wtmp\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585937    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-root\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:43.585958    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 26 19:28:43.585993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585989    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-sys\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586285 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.585993    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-root\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586285 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:28:43.586029    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls podName:f922eee1-8f66-419f-b350-0784ebdf4b47 nodeName:}" failed. No retries permitted until 2026-05-26 19:28:44.086010808 +0000 UTC m=+197.515588852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls") pod "node-exporter-fhmvw" (UID: "f922eee1-8f66-419f-b350-0784ebdf4b47") : secret "node-exporter-tls" not found
May 26 19:28:43.586285 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.586047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f922eee1-8f66-419f-b350-0784ebdf4b47-sys\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586285 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.586171    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-metrics-client-ca\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586419 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.586376    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-textfile\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586500 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.586482    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-accelerators-collector-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.586670 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.586654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f922eee1-8f66-419f-b350-0784ebdf4b47-metrics-client-ca\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.588139 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.588122    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:43.594306 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:43.594281    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4cgv\" (UniqueName: \"kubernetes.io/projected/f922eee1-8f66-419f-b350-0784ebdf4b47-kube-api-access-t4cgv\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:44.091029 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:44.090991    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:44.093243 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:44.093223    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f922eee1-8f66-419f-b350-0784ebdf4b47-node-exporter-tls\") pod \"node-exporter-fhmvw\" (UID: \"f922eee1-8f66-419f-b350-0784ebdf4b47\") " pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:44.338278 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:44.338232    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fhmvw"
May 26 19:28:44.346120 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:28:44.346090    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf922eee1_8f66_419f_b350_0784ebdf4b47.slice/crio-a72453af26a8d51ee6008b21d402b93d4435c358be8abd46dcc1c16769c29b2e WatchSource:0}: Error finding container a72453af26a8d51ee6008b21d402b93d4435c358be8abd46dcc1c16769c29b2e: Status 404 returned error can't find the container with id a72453af26a8d51ee6008b21d402b93d4435c358be8abd46dcc1c16769c29b2e
May 26 19:28:44.663910 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:44.663875    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fhmvw" event={"ID":"f922eee1-8f66-419f-b350-0784ebdf4b47","Type":"ContainerStarted","Data":"a72453af26a8d51ee6008b21d402b93d4435c358be8abd46dcc1c16769c29b2e"}
May 26 19:28:45.667548 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:45.667444    2576 generic.go:358] "Generic (PLEG): container finished" podID="f922eee1-8f66-419f-b350-0784ebdf4b47" containerID="bfaf16c4c4934a931530b4889674bfce1d3f27a9936a59a4b97aef126cfedf5e" exitCode=0
May 26 19:28:45.667878 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:45.667545    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fhmvw" event={"ID":"f922eee1-8f66-419f-b350-0784ebdf4b47","Type":"ContainerDied","Data":"bfaf16c4c4934a931530b4889674bfce1d3f27a9936a59a4b97aef126cfedf5e"}
May 26 19:28:46.671693 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:46.671659    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fhmvw" event={"ID":"f922eee1-8f66-419f-b350-0784ebdf4b47","Type":"ContainerStarted","Data":"52e98772741e6c9977f3f449b5d6c1bf16e98717f0c4992b9eca4a8120588ed3"}
May 26 19:28:46.671693 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:46.671694    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fhmvw" event={"ID":"f922eee1-8f66-419f-b350-0784ebdf4b47","Type":"ContainerStarted","Data":"ab98fe00f46e90b0824d151e748b8bd6e387575a7a26ddcfbf115132bc052f09"}
May 26 19:28:46.689828 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:46.689786    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fhmvw" podStartSLOduration=2.629073731 podStartE2EDuration="3.689773294s" podCreationTimestamp="2026-05-26 19:28:43 +0000 UTC" firstStartedPulling="2026-05-26 19:28:44.347865851 +0000 UTC m=+197.777443882" lastFinishedPulling="2026-05-26 19:28:45.408565417 +0000 UTC m=+198.838143445" observedRunningTime="2026-05-26 19:28:46.689146733 +0000 UTC m=+200.118724784" watchObservedRunningTime="2026-05-26 19:28:46.689773294 +0000 UTC m=+200.119351354"
May 26 19:28:49.681132 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:49.681099    2576 generic.go:358] "Generic (PLEG): container finished" podID="ca45bbf1-bb48-4069-9536-fce59272c65c" containerID="09ab9c2f9338aaabac009d27a71c22f63c2234e0726c72053f584d87a460387c" exitCode=255
May 26 19:28:49.681506 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:49.681135    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2" event={"ID":"ca45bbf1-bb48-4069-9536-fce59272c65c","Type":"ContainerDied","Data":"09ab9c2f9338aaabac009d27a71c22f63c2234e0726c72053f584d87a460387c"}
May 26 19:28:49.681506 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:49.681487    2576 scope.go:117] "RemoveContainer" containerID="09ab9c2f9338aaabac009d27a71c22f63c2234e0726c72053f584d87a460387c"
May 26 19:28:50.685060 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:28:50.685028    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77fc4878d-phtf2" event={"ID":"ca45bbf1-bb48-4069-9536-fce59272c65c","Type":"ContainerStarted","Data":"8bfc2a35a02734b34e7cbf4f87113217d773fd5b6f5a1a3c5392bf50491d5d4e"}
May 26 19:29:01.816284 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:01.816230    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" podUID="014c64fb-b987-45e4-92cc-4d664df6703f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:29:11.082908 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:11.082880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/init-textfile/0.log"
May 26 19:29:11.283398 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:11.283367    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/node-exporter/0.log"
May 26 19:29:11.483009 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:11.482980    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/kube-rbac-proxy/0.log"
May 26 19:29:11.816465 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:11.816373    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" podUID="014c64fb-b987-45e4-92cc-4d664df6703f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:29:19.483093 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:19.483066    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsvbh_73bfe9d1-d934-4450-8d01-2c074d6d307b/dns-node-resolver/0.log"
May 26 19:29:20.482937 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:20.482909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8452_9f1a8f1e-67b3-46ab-83b1-734f37eff620/node-ca/0.log"
May 26 19:29:21.815813 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:21.815770    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" podUID="014c64fb-b987-45e4-92cc-4d664df6703f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 26 19:29:21.816303 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:21.815838    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj"
May 26 19:29:21.816418 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:21.816373    2576 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"1a33ca0fc6e7f1f94be9fc36770b321c3827f48620903a00efc2eef67d7fc97a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 26 19:29:21.816486 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:21.816459    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" podUID="014c64fb-b987-45e4-92cc-4d664df6703f" containerName="service-proxy" containerID="cri-o://1a33ca0fc6e7f1f94be9fc36770b321c3827f48620903a00efc2eef67d7fc97a" gracePeriod=30
May 26 19:29:22.774350 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:22.774301    2576 generic.go:358] "Generic (PLEG): container finished" podID="014c64fb-b987-45e4-92cc-4d664df6703f" containerID="1a33ca0fc6e7f1f94be9fc36770b321c3827f48620903a00efc2eef67d7fc97a" exitCode=2
May 26 19:29:22.774506 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:22.774360    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerDied","Data":"1a33ca0fc6e7f1f94be9fc36770b321c3827f48620903a00efc2eef67d7fc97a"}
May 26 19:29:22.774506 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:22.774396    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c9bbc47ff-wrrlj" event={"ID":"014c64fb-b987-45e4-92cc-4d664df6703f","Type":"ContainerStarted","Data":"b02aabe3e96a0ef8a2c695f4fbd1f199dee5ce8718fd09fc2776aa6c4261361d"}
May 26 19:29:39.035878 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.035829    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:29:39.038212 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.038183    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cceaa09b-1667-44ab-8040-c817956ce806-metrics-certs\") pod \"network-metrics-daemon-qbzzm\" (UID: \"cceaa09b-1667-44ab-8040-c817956ce806\") " pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:29:39.102197 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.102164    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9trh\""
May 26 19:29:39.109960 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.109941    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qbzzm"
May 26 19:29:39.231482 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.231449    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qbzzm"]
May 26 19:29:39.234206 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:29:39.234157    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcceaa09b_1667_44ab_8040_c817956ce806.slice/crio-9db2d94fa4ec2ebeeb6eecc4e36e5eeba39e6668e368f6cc0a8fc59187c3c468 WatchSource:0}: Error finding container 9db2d94fa4ec2ebeeb6eecc4e36e5eeba39e6668e368f6cc0a8fc59187c3c468: Status 404 returned error can't find the container with id 9db2d94fa4ec2ebeeb6eecc4e36e5eeba39e6668e368f6cc0a8fc59187c3c468
May 26 19:29:39.820205 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:39.820167    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbzzm" event={"ID":"cceaa09b-1667-44ab-8040-c817956ce806","Type":"ContainerStarted","Data":"9db2d94fa4ec2ebeeb6eecc4e36e5eeba39e6668e368f6cc0a8fc59187c3c468"}
May 26 19:29:40.824548 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:40.824502    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbzzm" event={"ID":"cceaa09b-1667-44ab-8040-c817956ce806","Type":"ContainerStarted","Data":"5f8fe72c9f20caff64bedeab71a4a258802930922a3aebefdec3f7918d379748"}
May 26 19:29:40.824935 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:40.824560    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qbzzm" event={"ID":"cceaa09b-1667-44ab-8040-c817956ce806","Type":"ContainerStarted","Data":"706fbfb0a50b698e18dd42bd8c4e8c7ae8c7a854df7f707d119a11a92caaf6d5"}
May 26 19:29:40.840513 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:29:40.840470    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qbzzm" podStartSLOduration=252.813954947 podStartE2EDuration="4m13.840458137s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="2026-05-26 19:29:39.236019406 +0000 UTC m=+252.665597434" lastFinishedPulling="2026-05-26 19:29:40.262522594 +0000 UTC m=+253.692100624" observedRunningTime="2026-05-26 19:29:40.839554696 +0000 UTC m=+254.269132741" watchObservedRunningTime="2026-05-26 19:29:40.840458137 +0000 UTC m=+254.270036186"
May 26 19:30:07.561624 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:07.561587    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8"
May 26 19:30:07.561624 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:07.561587    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xf7v8" podUID="7d306ecf-acb7-4086-bada-412aabdec97d"
May 26 19:30:07.562070 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:07.561595    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd" podUID="5bce422a-412b-4059-8819-cb18623ba19e"
May 26 19:30:07.562070 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:07.561595    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ssq2v" podUID="2453915b-ca88-440b-8f04-82378382f88d"
May 26 19:30:07.896517 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:07.896488    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:30:07.896517 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:07.896506    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:07.896746 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:07.896507    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:30:07.896746 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:07.896489    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:11.594702 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.594667    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:11.595247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.594708    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:30:11.595247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.594752    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:30:11.595247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.594783    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:11.597076 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.597051    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d306ecf-acb7-4086-bada-412aabdec97d-metrics-tls\") pod \"dns-default-xf7v8\" (UID: \"7d306ecf-acb7-4086-bada-412aabdec97d\") " pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:11.597303 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.597282    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2453915b-ca88-440b-8f04-82378382f88d-cert\") pod \"ingress-canary-ssq2v\" (UID: \"2453915b-ca88-440b-8f04-82378382f88d\") " pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:30:11.597469 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.597452    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5bce422a-412b-4059-8819-cb18623ba19e-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-cchcd\" (UID: \"5bce422a-412b-4059-8819-cb18623ba19e\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:30:11.597516 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.597498    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"image-registry-fc7f4564-knmnt\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") " pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:11.800228 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.800196    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtv8f\""
May 26 19:30:11.800228 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.800226    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhp6d\""
May 26 19:30:11.800228 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.800233    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wk6bq\""
May 26 19:30:11.800511 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.800204    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dljqb\""
May 26 19:30:11.807275 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.807258    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"
May 26 19:30:11.807362 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.807349    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:11.807406 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.807363    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:11.807521 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.807503    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ssq2v"
May 26 19:30:11.970674 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:11.970648    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:30:11.973185 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:30:11.973148    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d2b243_bf92_43be_9c2b_6146e8c0c3a8.slice/crio-26f8cb3552250f8b3a2cd9a49388a76236b11760579292cc705a5d866e2788ab WatchSource:0}: Error finding container 26f8cb3552250f8b3a2cd9a49388a76236b11760579292cc705a5d866e2788ab: Status 404 returned error can't find the container with id 26f8cb3552250f8b3a2cd9a49388a76236b11760579292cc705a5d866e2788ab
May 26 19:30:12.191106 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.191026    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xf7v8"]
May 26 19:30:12.194073 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.194046    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ssq2v"]
May 26 19:30:12.198252 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.195195    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd"]
May 26 19:30:12.198252 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:30:12.195944    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d306ecf_acb7_4086_bada_412aabdec97d.slice/crio-5575a4d5744a3cd20ef29d0c4a7d55f4a0de489b54e51c9f9a9d90bbb3d3469b WatchSource:0}: Error finding container 5575a4d5744a3cd20ef29d0c4a7d55f4a0de489b54e51c9f9a9d90bbb3d3469b: Status 404 returned error can't find the container with id 5575a4d5744a3cd20ef29d0c4a7d55f4a0de489b54e51c9f9a9d90bbb3d3469b
May 26 19:30:12.198252 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:30:12.197932    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bce422a_412b_4059_8819_cb18623ba19e.slice/crio-8fbfad288d2703c711265484a46d4139f67e184144a497d3d17b3b01cea33431 WatchSource:0}: Error finding container 8fbfad288d2703c711265484a46d4139f67e184144a497d3d17b3b01cea33431: Status 404 returned error can't find the container with id 8fbfad288d2703c711265484a46d4139f67e184144a497d3d17b3b01cea33431
May 26 19:30:12.200085 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:30:12.200050    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2453915b_ca88_440b_8f04_82378382f88d.slice/crio-d3dff624c53f72b94f06e5446ad5449376f9b47637d376d4be37111cfe786ba2 WatchSource:0}: Error finding container d3dff624c53f72b94f06e5446ad5449376f9b47637d376d4be37111cfe786ba2: Status 404 returned error can't find the container with id d3dff624c53f72b94f06e5446ad5449376f9b47637d376d4be37111cfe786ba2
May 26 19:30:12.911080 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.911020    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf7v8" event={"ID":"7d306ecf-acb7-4086-bada-412aabdec97d","Type":"ContainerStarted","Data":"5575a4d5744a3cd20ef29d0c4a7d55f4a0de489b54e51c9f9a9d90bbb3d3469b"}
May 26 19:30:12.913090 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.913062    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" event={"ID":"71d2b243-bf92-43be-9c2b-6146e8c0c3a8","Type":"ContainerStarted","Data":"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"}
May 26 19:30:12.913235 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.913098    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" event={"ID":"71d2b243-bf92-43be-9c2b-6146e8c0c3a8","Type":"ContainerStarted","Data":"26f8cb3552250f8b3a2cd9a49388a76236b11760579292cc705a5d866e2788ab"}
May 26 19:30:12.913235 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.913228    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:12.915021 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.914995    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd" event={"ID":"5bce422a-412b-4059-8819-cb18623ba19e","Type":"ContainerStarted","Data":"8fbfad288d2703c711265484a46d4139f67e184144a497d3d17b3b01cea33431"}
May 26 19:30:12.916493 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.916465    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssq2v" event={"ID":"2453915b-ca88-440b-8f04-82378382f88d","Type":"ContainerStarted","Data":"d3dff624c53f72b94f06e5446ad5449376f9b47637d376d4be37111cfe786ba2"}
May 26 19:30:12.934253 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:12.934205    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" podStartSLOduration=285.934188043 podStartE2EDuration="4m45.934188043s" podCreationTimestamp="2026-05-26 19:25:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:30:12.931960388 +0000 UTC m=+286.361538469" watchObservedRunningTime="2026-05-26 19:30:12.934188043 +0000 UTC m=+286.363766095"
May 26 19:30:14.924303 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.924264    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ssq2v" event={"ID":"2453915b-ca88-440b-8f04-82378382f88d","Type":"ContainerStarted","Data":"5185fbc0c8e03736dbfb724dbcff3b7064e4ca2345aba2cf854839e2bed88745"}
May 26 19:30:14.925821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.925792    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf7v8" event={"ID":"7d306ecf-acb7-4086-bada-412aabdec97d","Type":"ContainerStarted","Data":"8b4f9504cc8cf3151b0bc8bef3fb60e78edb873926364b36008f3c4c1c960cc5"}
May 26 19:30:14.925947 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.925825    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xf7v8" event={"ID":"7d306ecf-acb7-4086-bada-412aabdec97d","Type":"ContainerStarted","Data":"ab751c161043af3730c61db8ef64b3a036f30cf5d0255125bf04e2e6a2cf1c03"}
May 26 19:30:14.925947 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.925922    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:14.926995 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.926973    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd" event={"ID":"5bce422a-412b-4059-8819-cb18623ba19e","Type":"ContainerStarted","Data":"b8cd62a6ce670bff0e60839d40ee8ab86d186ee9f58e672a543d3c74294344fb"}
May 26 19:30:14.939458 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.939413    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ssq2v" podStartSLOduration=251.877338091 podStartE2EDuration="4m13.939402745s" podCreationTimestamp="2026-05-26 19:26:01 +0000 UTC" firstStartedPulling="2026-05-26 19:30:12.202054912 +0000 UTC m=+285.631632957" lastFinishedPulling="2026-05-26 19:30:14.264119583 +0000 UTC m=+287.693697611" observedRunningTime="2026-05-26 19:30:14.938249448 +0000 UTC m=+288.367827499" watchObservedRunningTime="2026-05-26 19:30:14.939402745 +0000 UTC m=+288.368980788"
May 26 19:30:14.955985 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.955946    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-cchcd" podStartSLOduration=263.899214174 podStartE2EDuration="4m25.955934913s" podCreationTimestamp="2026-05-26 19:25:49 +0000 UTC" firstStartedPulling="2026-05-26 19:30:12.200706641 +0000 UTC m=+285.630284674" lastFinishedPulling="2026-05-26 19:30:14.257427382 +0000 UTC m=+287.687005413" observedRunningTime="2026-05-26 19:30:14.954341927 +0000 UTC m=+288.383919977" watchObservedRunningTime="2026-05-26 19:30:14.955934913 +0000 UTC m=+288.385512962"
May 26 19:30:14.969858 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:14.969799    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xf7v8" podStartSLOduration=251.911589061 podStartE2EDuration="4m13.969779668s" podCreationTimestamp="2026-05-26 19:26:01 +0000 UTC" firstStartedPulling="2026-05-26 19:30:12.200216082 +0000 UTC m=+285.629794115" lastFinishedPulling="2026-05-26 19:30:14.258406682 +0000 UTC m=+287.687984722" observedRunningTime="2026-05-26 19:30:14.9692068 +0000 UTC m=+288.398784849" watchObservedRunningTime="2026-05-26 19:30:14.969779668 +0000 UTC m=+288.399357718"
May 26 19:30:19.943981 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:19.943942    2576 generic.go:358] "Generic (PLEG): container finished" podID="9ca736ac-5101-4ea1-aa84-50e460d1de32" containerID="a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947" exitCode=1
May 26 19:30:19.944454 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:19.944010    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerDied","Data":"a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"}
May 26 19:30:19.944454 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:19.944054    2576 scope.go:117] "RemoveContainer" containerID="49873261cadbda239ce3293cb937030348bd8e2ef12a9edc338a22bac1d8c0a1"
May 26 19:30:19.944454 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:19.944330    2576 scope.go:117] "RemoveContainer" containerID="a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"
May 26 19:30:19.944590 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:19.944577    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6bb5df74f-2l74j_open-cluster-management-agent-addon(9ca736ac-5101-4ea1-aa84-50e460d1de32)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" podUID="9ca736ac-5101-4ea1-aa84-50e460d1de32"
May 26 19:30:20.599999 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:20.599967    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:30:20.948553 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:20.948512    2576 scope.go:117] "RemoveContainer" containerID="a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"
May 26 19:30:20.949028 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:20.948779    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6bb5df74f-2l74j_open-cluster-management-agent-addon(9ca736ac-5101-4ea1-aa84-50e460d1de32)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" podUID="9ca736ac-5101-4ea1-aa84-50e460d1de32"
May 26 19:30:21.833385 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:21.833356    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:30:21.951925 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:21.951899    2576 scope.go:117] "RemoveContainer" containerID="a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"
May 26 19:30:21.952288 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:30:21.952080    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6bb5df74f-2l74j_open-cluster-management-agent-addon(9ca736ac-5101-4ea1-aa84-50e460d1de32)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" podUID="9ca736ac-5101-4ea1-aa84-50e460d1de32"
May 26 19:30:24.932260 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:24.932231    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xf7v8"
May 26 19:30:27.057654 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:27.057626    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:30:27.058647 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:27.058628    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:30:27.060939 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:27.060917    2576 kubelet.go:1628] "Image garbage collection succeeded"
May 26 19:30:31.811247 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:31.811216    2576 patch_prober.go:28] interesting pod/image-registry-fc7f4564-knmnt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 19:30:31.813588 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:31.811277    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:30:33.923779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:33.923751    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:30:34.964935 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:34.964905    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:30:35.098979 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:35.098949    2576 scope.go:117] "RemoveContainer" containerID="a7e1e409a4500bd57ac5872691dd9ec48ab99056501d185660f45f2aa35cb947"
May 26 19:30:35.099875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:35.099859    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:30:35.987693 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:35.987654    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j" event={"ID":"9ca736ac-5101-4ea1-aa84-50e460d1de32","Type":"ContainerStarted","Data":"0a4ce206ce2492f86f03d8406f8a519d976c8015134c11b5f995df7175443424"}
May 26 19:30:35.988176 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:35.987947    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:30:35.989701 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:35.989676    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bb5df74f-2l74j"
May 26 19:30:59.983487 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:30:59.983423    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerName="registry" containerID="cri-o://579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6" gracePeriod=30
May 26 19:31:01.219604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.219575    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:31:01.345605 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345484    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345605 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345556    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345605 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345587    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345850 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345624    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5c9zn\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345850 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345668    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345850 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345702    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345850 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345735    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.345850 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.345763    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration\") pod \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\" (UID: \"71d2b243-bf92-43be-9c2b-6146e8c0c3a8\") "
May 26 19:31:01.346111 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.346053    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:31:01.346286 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.346256    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:31:01.348159 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.348129    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn" (OuterVolumeSpecName: "kube-api-access-5c9zn") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "kube-api-access-5c9zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:31:01.348415 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.348369    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:31:01.348548 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.348480    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:31:01.348548 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.348503    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:31:01.348671 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.348553    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:31:01.355502 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.355475    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "71d2b243-bf92-43be-9c2b-6146e8c0c3a8" (UID: "71d2b243-bf92-43be-9c2b-6146e8c0c3a8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:31:01.446322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446285    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-image-registry-private-configuration\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446318    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-bound-sa-token\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446329    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-certificates\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446338    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-ca-trust-extracted\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446347    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5c9zn\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-kube-api-access-5c9zn\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446356    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-installation-pull-secrets\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446365    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-registry-tls\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:01.446574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:01.446374    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/71d2b243-bf92-43be-9c2b-6146e8c0c3a8-trusted-ca\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:31:02.057867 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.057830    2576 generic.go:358] "Generic (PLEG): container finished" podID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerID="579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6" exitCode=0
May 26 19:31:02.058052 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.057895    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc7f4564-knmnt"
May 26 19:31:02.058052 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.057915    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" event={"ID":"71d2b243-bf92-43be-9c2b-6146e8c0c3a8","Type":"ContainerDied","Data":"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"}
May 26 19:31:02.058052 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.057953    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc7f4564-knmnt" event={"ID":"71d2b243-bf92-43be-9c2b-6146e8c0c3a8","Type":"ContainerDied","Data":"26f8cb3552250f8b3a2cd9a49388a76236b11760579292cc705a5d866e2788ab"}
May 26 19:31:02.058052 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.057968    2576 scope.go:117] "RemoveContainer" containerID="579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"
May 26 19:31:02.066599 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.066582    2576 scope.go:117] "RemoveContainer" containerID="579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"
May 26 19:31:02.066868 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:31:02.066848    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6\": container with ID starting with 579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6 not found: ID does not exist" containerID="579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"
May 26 19:31:02.066914 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.066877    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6"} err="failed to get container status \"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6\": rpc error: code = NotFound desc = could not find container \"579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6\": container with ID starting with 579730d544c7a2c577824c8de33eee3233638ee30284851b3f7a051b61b113c6 not found: ID does not exist"
May 26 19:31:02.079842 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.079816    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:31:02.083328 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:02.083309    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc7f4564-knmnt"]
May 26 19:31:03.101877 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:31:03.101847    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" path="/var/lib/kubelet/pods/71d2b243-bf92-43be-9c2b-6146e8c0c3a8/volumes"
May 26 19:35:27.075001 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:35:27.074970    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:35:27.076714 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:35:27.076692    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:36:30.974015 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.973981    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"]
May 26 19:36:30.974414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.974201    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerName="registry"
May 26 19:36:30.974414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.974210    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerName="registry"
May 26 19:36:30.974414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.974262    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="71d2b243-bf92-43be-9c2b-6146e8c0c3a8" containerName="registry"
May 26 19:36:30.976793 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.976777    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:30.978931 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.978908    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 26 19:36:30.979690 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.979668    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 26 19:36:30.979785 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.979690    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jmch5\""
May 26 19:36:30.984242 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:30.984222    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"]
May 26 19:36:31.068621 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.068592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlr5r\" (UniqueName: \"kubernetes.io/projected/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-kube-api-access-xlr5r\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.068779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.068639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-tmp\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.168951 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.168916    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-tmp\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.169115 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.168976    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xlr5r\" (UniqueName: \"kubernetes.io/projected/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-kube-api-access-xlr5r\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.169286 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.169266    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-tmp\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.177004 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.176975    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlr5r\" (UniqueName: \"kubernetes.io/projected/cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28-kube-api-access-xlr5r\") pod \"openshift-lws-operator-bfc7f696d-psbcn\" (UID: \"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.286109 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.286026    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"
May 26 19:36:31.406473 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.406444    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn"]
May 26 19:36:31.407733 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:36:31.407706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd2b6d81_e31d_4eec_b382_ff7fd0cbbb28.slice/crio-637448058aa5f76ad295ac00be01568d60031c8aba8be8d688e8d995526fe151 WatchSource:0}: Error finding container 637448058aa5f76ad295ac00be01568d60031c8aba8be8d688e8d995526fe151: Status 404 returned error can't find the container with id 637448058aa5f76ad295ac00be01568d60031c8aba8be8d688e8d995526fe151
May 26 19:36:31.409084 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.409066    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:36:31.888674 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:31.888638    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn" event={"ID":"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28","Type":"ContainerStarted","Data":"637448058aa5f76ad295ac00be01568d60031c8aba8be8d688e8d995526fe151"}
May 26 19:36:36.906198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:36.906159    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn" event={"ID":"cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28","Type":"ContainerStarted","Data":"b80c6460cc072dc854fad27ef9308ffd5c86fd1a08821c599d2a03b3fb918047"}
May 26 19:36:36.923103 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:36.923054    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-psbcn" podStartSLOduration=1.9472276659999999 podStartE2EDuration="6.923039981s" podCreationTimestamp="2026-05-26 19:36:30 +0000 UTC" firstStartedPulling="2026-05-26 19:36:31.409189557 +0000 UTC m=+664.838767588" lastFinishedPulling="2026-05-26 19:36:36.385001875 +0000 UTC m=+669.814579903" observedRunningTime="2026-05-26 19:36:36.921836962 +0000 UTC m=+670.351415013" watchObservedRunningTime="2026-05-26 19:36:36.923039981 +0000 UTC m=+670.352618031"
May 26 19:36:52.012022 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.011991    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"]
May 26 19:36:52.015351 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.015330    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.018219 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.018200    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 19:36:52.018463 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.018447    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-krg4l\""
May 26 19:36:52.018853 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.018834    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 19:36:52.018936 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.018909    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 19:36:52.018936 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.018913    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 19:36:52.039471 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.039437    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"]
May 26 19:36:52.121650 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.121613    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.121837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.121677    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.121837 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.121707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx5x7\" (UniqueName: \"kubernetes.io/projected/252763e7-53f2-4ab7-a1de-86ab1a470ffc-kube-api-access-dx5x7\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.222562 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.222518    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.222738 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.222578    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.222738 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.222599    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dx5x7\" (UniqueName: \"kubernetes.io/projected/252763e7-53f2-4ab7-a1de-86ab1a470ffc-kube-api-access-dx5x7\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.225011 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.224987    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-webhook-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.225131 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.225012    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/252763e7-53f2-4ab7-a1de-86ab1a470ffc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.230113 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.230089    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx5x7\" (UniqueName: \"kubernetes.io/projected/252763e7-53f2-4ab7-a1de-86ab1a470ffc-kube-api-access-dx5x7\") pod \"opendatahub-operator-controller-manager-94b8b45bb-cxldc\" (UID: \"252763e7-53f2-4ab7-a1de-86ab1a470ffc\") " pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.325290 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.325225    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:52.458338 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.458294    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"]
May 26 19:36:52.461199 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:36:52.461166    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252763e7_53f2_4ab7_a1de_86ab1a470ffc.slice/crio-a94601597942503bd5b4201b8b1d35e933523f3af6f42713cde6b4dbcaaefe9f WatchSource:0}: Error finding container a94601597942503bd5b4201b8b1d35e933523f3af6f42713cde6b4dbcaaefe9f: Status 404 returned error can't find the container with id a94601597942503bd5b4201b8b1d35e933523f3af6f42713cde6b4dbcaaefe9f
May 26 19:36:52.950286 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:52.950247    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc" event={"ID":"252763e7-53f2-4ab7-a1de-86ab1a470ffc","Type":"ContainerStarted","Data":"a94601597942503bd5b4201b8b1d35e933523f3af6f42713cde6b4dbcaaefe9f"}
May 26 19:36:55.959238 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:55.959199    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc" event={"ID":"252763e7-53f2-4ab7-a1de-86ab1a470ffc","Type":"ContainerStarted","Data":"88661310d8e2a1c2074906260c3328d0e7caf7003b8aac0aa17f357a3eaecbe5"}
May 26 19:36:55.959643 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:55.959321    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:36:55.979034 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:36:55.978993    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc" podStartSLOduration=2.466302617 podStartE2EDuration="4.978981886s" podCreationTimestamp="2026-05-26 19:36:51 +0000 UTC" firstStartedPulling="2026-05-26 19:36:52.462996947 +0000 UTC m=+685.892574975" lastFinishedPulling="2026-05-26 19:36:54.975676197 +0000 UTC m=+688.405254244" observedRunningTime="2026-05-26 19:36:55.978713782 +0000 UTC m=+689.408291835" watchObservedRunningTime="2026-05-26 19:36:55.978981886 +0000 UTC m=+689.408559935"
May 26 19:37:06.965179 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:06.965094    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-94b8b45bb-cxldc"
May 26 19:37:12.874318 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.874283    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"]
May 26 19:37:12.877274 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.877254    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:12.879221 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.879203    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 26 19:37:12.879333 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.879311    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 26 19:37:12.880205 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.880189    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l7zjd\""
May 26 19:37:12.880280 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.880265    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 19:37:12.880324 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.880275    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 19:37:12.885235 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.885215    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"]
May 26 19:37:12.973220 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.973190    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tls-certs\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:12.973362 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.973235    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvlq\" (UniqueName: \"kubernetes.io/projected/f2370c53-51ea-44f9-8f64-89de31b1cb1a-kube-api-access-rrvlq\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:12.973362 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:12.973320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tmp\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.074196 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.074165    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvlq\" (UniqueName: \"kubernetes.io/projected/f2370c53-51ea-44f9-8f64-89de31b1cb1a-kube-api-access-rrvlq\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.074356 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.074222    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tmp\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.074356 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.074256    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tls-certs\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.076495 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.076466    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tmp\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.076833 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.076812    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2370c53-51ea-44f9-8f64-89de31b1cb1a-tls-certs\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.081237 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.081220    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvlq\" (UniqueName: \"kubernetes.io/projected/f2370c53-51ea-44f9-8f64-89de31b1cb1a-kube-api-access-rrvlq\") pod \"kube-auth-proxy-59cf57849b-cwf55\" (UID: \"f2370c53-51ea-44f9-8f64-89de31b1cb1a\") " pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.187643 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.187562    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"
May 26 19:37:13.309048 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.309023    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59cf57849b-cwf55"]
May 26 19:37:13.311271 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:37:13.311243    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2370c53_51ea_44f9_8f64_89de31b1cb1a.slice/crio-b8db0d9e1d111734977ef2defcf33bcb72c113e33907b7ab06c666056235beb9 WatchSource:0}: Error finding container b8db0d9e1d111734977ef2defcf33bcb72c113e33907b7ab06c666056235beb9: Status 404 returned error can't find the container with id b8db0d9e1d111734977ef2defcf33bcb72c113e33907b7ab06c666056235beb9
May 26 19:37:13.797603 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.797571    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rdskm"]
May 26 19:37:13.802445 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.802417    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:13.804789 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.804766    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7rww6\""
May 26 19:37:13.804902 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.804766    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
May 26 19:37:13.807636 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.807614    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rdskm"]
May 26 19:37:13.981576 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.981519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:13.981948 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:13.981590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnchn\" (UniqueName: \"kubernetes.io/projected/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-kube-api-access-lnchn\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.010615 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.010583    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55" event={"ID":"f2370c53-51ea-44f9-8f64-89de31b1cb1a","Type":"ContainerStarted","Data":"b8db0d9e1d111734977ef2defcf33bcb72c113e33907b7ab06c666056235beb9"}
May 26 19:37:14.082847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.082776    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.082847 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.082828    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnchn\" (UniqueName: \"kubernetes.io/projected/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-kube-api-access-lnchn\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.082995 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:14.082925    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
May 26 19:37:14.083029 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:14.082999    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert podName:6532d3cc-ab80-4964-b7d3-d079ab4a8c90 nodeName:}" failed. No retries permitted until 2026-05-26 19:37:14.582981203 +0000 UTC m=+708.012559234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert") pod "odh-model-controller-858dbf95b8-rdskm" (UID: "6532d3cc-ab80-4964-b7d3-d079ab4a8c90") : secret "odh-model-controller-webhook-cert" not found
May 26 19:37:14.092786 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.092759    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnchn\" (UniqueName: \"kubernetes.io/projected/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-kube-api-access-lnchn\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.587043 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.587007    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.589347 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.589320    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6532d3cc-ab80-4964-b7d3-d079ab4a8c90-cert\") pod \"odh-model-controller-858dbf95b8-rdskm\" (UID: \"6532d3cc-ab80-4964-b7d3-d079ab4a8c90\") " pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.714223 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.714186    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:14.832588 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:14.832420    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-858dbf95b8-rdskm"]
May 26 19:37:14.835058 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:37:14.835031    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6532d3cc_ab80_4964_b7d3_d079ab4a8c90.slice/crio-ecc01ffbeffd2855728c0cf3632a00bff2d137b97d7cbb7aa2933c05066c547f WatchSource:0}: Error finding container ecc01ffbeffd2855728c0cf3632a00bff2d137b97d7cbb7aa2933c05066c547f: Status 404 returned error can't find the container with id ecc01ffbeffd2855728c0cf3632a00bff2d137b97d7cbb7aa2933c05066c547f
May 26 19:37:15.014286 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:15.014249    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" event={"ID":"6532d3cc-ab80-4964-b7d3-d079ab4a8c90","Type":"ContainerStarted","Data":"ecc01ffbeffd2855728c0cf3632a00bff2d137b97d7cbb7aa2933c05066c547f"}
May 26 19:37:18.025516 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:18.025331    2576 generic.go:358] "Generic (PLEG): container finished" podID="6532d3cc-ab80-4964-b7d3-d079ab4a8c90" containerID="ad2d218314299bd6b2f9c1e3ac33fded6c32868a82b0ca739468b405c86a33bd" exitCode=1
May 26 19:37:18.025516 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:18.025416    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" event={"ID":"6532d3cc-ab80-4964-b7d3-d079ab4a8c90","Type":"ContainerDied","Data":"ad2d218314299bd6b2f9c1e3ac33fded6c32868a82b0ca739468b405c86a33bd"}
May 26 19:37:18.026040 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:18.025683    2576 scope.go:117] "RemoveContainer" containerID="ad2d218314299bd6b2f9c1e3ac33fded6c32868a82b0ca739468b405c86a33bd"
May 26 19:37:19.033992 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.033946    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" event={"ID":"6532d3cc-ab80-4964-b7d3-d079ab4a8c90","Type":"ContainerStarted","Data":"691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1"}
May 26 19:37:19.034433 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.034168    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:19.056312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.056267    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" podStartSLOduration=2.572580236 podStartE2EDuration="6.056250373s" podCreationTimestamp="2026-05-26 19:37:13 +0000 UTC" firstStartedPulling="2026-05-26 19:37:14.836369843 +0000 UTC m=+708.265947874" lastFinishedPulling="2026-05-26 19:37:18.320039966 +0000 UTC m=+711.749618011" observedRunningTime="2026-05-26 19:37:19.054918128 +0000 UTC m=+712.484496179" watchObservedRunningTime="2026-05-26 19:37:19.056250373 +0000 UTC m=+712.485828441"
May 26 19:37:19.262396 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.262339    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7w8s4"]
May 26 19:37:19.266064 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.266043    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:19.268302 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.268278    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lmvvp\""
May 26 19:37:19.268302 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.268308    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
May 26 19:37:19.273293 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.273266    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7w8s4"]
May 26 19:37:19.430093 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.430053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr48m\" (UniqueName: \"kubernetes.io/projected/fc3d19a4-5021-4775-97f7-e273765f6e4c-kube-api-access-xr48m\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:19.430279 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.430105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:19.531346 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.531308    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:19.531565 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.531455    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr48m\" (UniqueName: \"kubernetes.io/projected/fc3d19a4-5021-4775-97f7-e273765f6e4c-kube-api-access-xr48m\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:19.531565 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:19.531497    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
May 26 19:37:19.531697 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:19.531595    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert podName:fc3d19a4-5021-4775-97f7-e273765f6e4c nodeName:}" failed. No retries permitted until 2026-05-26 19:37:20.031570736 +0000 UTC m=+713.461148771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert") pod "kserve-controller-manager-856948b99f-7w8s4" (UID: "fc3d19a4-5021-4775-97f7-e273765f6e4c") : secret "kserve-webhook-server-cert" not found
May 26 19:37:19.543099 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:19.543068    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr48m\" (UniqueName: \"kubernetes.io/projected/fc3d19a4-5021-4775-97f7-e273765f6e4c-kube-api-access-xr48m\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:20.035263 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.035178    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:20.038022 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.037992    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc3d19a4-5021-4775-97f7-e273765f6e4c-cert\") pod \"kserve-controller-manager-856948b99f-7w8s4\" (UID: \"fc3d19a4-5021-4775-97f7-e273765f6e4c\") " pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:20.038182 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.038154    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55" event={"ID":"f2370c53-51ea-44f9-8f64-89de31b1cb1a","Type":"ContainerStarted","Data":"0616d06fed92231f3d36c3147e8b3031022f8a784f497c6fd296a59604e759f1"}
May 26 19:37:20.039767 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.039744    2576 generic.go:358] "Generic (PLEG): container finished" podID="6532d3cc-ab80-4964-b7d3-d079ab4a8c90" containerID="691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1" exitCode=1
May 26 19:37:20.039852 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.039808    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" event={"ID":"6532d3cc-ab80-4964-b7d3-d079ab4a8c90","Type":"ContainerDied","Data":"691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1"}
May 26 19:37:20.039852 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.039842    2576 scope.go:117] "RemoveContainer" containerID="ad2d218314299bd6b2f9c1e3ac33fded6c32868a82b0ca739468b405c86a33bd"
May 26 19:37:20.039997 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.039977    2576 scope.go:117] "RemoveContainer" containerID="691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1"
May 26 19:37:20.040195 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:20.040174    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rdskm_opendatahub(6532d3cc-ab80-4964-b7d3-d079ab4a8c90)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" podUID="6532d3cc-ab80-4964-b7d3-d079ab4a8c90"
May 26 19:37:20.052756 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.052709    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59cf57849b-cwf55" podStartSLOduration=1.442504645 podStartE2EDuration="8.052695042s" podCreationTimestamp="2026-05-26 19:37:12 +0000 UTC" firstStartedPulling="2026-05-26 19:37:13.31294735 +0000 UTC m=+706.742525379" lastFinishedPulling="2026-05-26 19:37:19.923137744 +0000 UTC m=+713.352715776" observedRunningTime="2026-05-26 19:37:20.051358406 +0000 UTC m=+713.480936455" watchObservedRunningTime="2026-05-26 19:37:20.052695042 +0000 UTC m=+713.482273097"
May 26 19:37:20.178317 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.178241    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:20.297307 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:20.297282    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-856948b99f-7w8s4"]
May 26 19:37:20.299412 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:37:20.299382    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3d19a4_5021_4775_97f7_e273765f6e4c.slice/crio-6bbc3fed6f63dfa2834dd80bb33e1168ff941d02087f40b9b284f4e071261ffc WatchSource:0}: Error finding container 6bbc3fed6f63dfa2834dd80bb33e1168ff941d02087f40b9b284f4e071261ffc: Status 404 returned error can't find the container with id 6bbc3fed6f63dfa2834dd80bb33e1168ff941d02087f40b9b284f4e071261ffc
May 26 19:37:21.045181 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:21.045154    2576 scope.go:117] "RemoveContainer" containerID="691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1"
May 26 19:37:21.045647 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:37:21.045369    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=odh-model-controller-858dbf95b8-rdskm_opendatahub(6532d3cc-ab80-4964-b7d3-d079ab4a8c90)\"" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" podUID="6532d3cc-ab80-4964-b7d3-d079ab4a8c90"
May 26 19:37:21.046064 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:21.046029    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4" event={"ID":"fc3d19a4-5021-4775-97f7-e273765f6e4c","Type":"ContainerStarted","Data":"6bbc3fed6f63dfa2834dd80bb33e1168ff941d02087f40b9b284f4e071261ffc"}
May 26 19:37:24.056652 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:24.056615    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4" event={"ID":"fc3d19a4-5021-4775-97f7-e273765f6e4c","Type":"ContainerStarted","Data":"5b63b9abbdb451fb72ecb041e4ba1478bd11f21988220101e332a1c8b2ad8375"}
May 26 19:37:24.057144 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:24.056666    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:37:24.087654 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:24.087610    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4" podStartSLOduration=1.448026109 podStartE2EDuration="5.087596104s" podCreationTimestamp="2026-05-26 19:37:19 +0000 UTC" firstStartedPulling="2026-05-26 19:37:20.300740868 +0000 UTC m=+713.730318895" lastFinishedPulling="2026-05-26 19:37:23.940310859 +0000 UTC m=+717.369888890" observedRunningTime="2026-05-26 19:37:24.086407233 +0000 UTC m=+717.515985282" watchObservedRunningTime="2026-05-26 19:37:24.087596104 +0000 UTC m=+717.517174154"
May 26 19:37:26.432518 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.432484    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"]
May 26 19:37:26.435772 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.435756    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.438156 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.438136    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-zk5tw\""
May 26 19:37:26.438288 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.438221    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\""
May 26 19:37:26.438288 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.438242    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\""
May 26 19:37:26.450342 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.450323    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"]
May 26 19:37:26.481598 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.481570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/24a3869d-c423-45a7-8d60-fd6e894ed81e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.481727 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.481657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42zwd\" (UniqueName: \"kubernetes.io/projected/24a3869d-c423-45a7-8d60-fd6e894ed81e-kube-api-access-42zwd\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.582164 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.582129    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-42zwd\" (UniqueName: \"kubernetes.io/projected/24a3869d-c423-45a7-8d60-fd6e894ed81e-kube-api-access-42zwd\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.582322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.582185    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/24a3869d-c423-45a7-8d60-fd6e894ed81e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.584738 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.584715    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/24a3869d-c423-45a7-8d60-fd6e894ed81e-operator-config\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.593452 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.593425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42zwd\" (UniqueName: \"kubernetes.io/projected/24a3869d-c423-45a7-8d60-fd6e894ed81e-kube-api-access-42zwd\") pod \"servicemesh-operator3-55f49c5f94-zjk8c\" (UID: \"24a3869d-c423-45a7-8d60-fd6e894ed81e\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.744549 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.744427    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:26.871342 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:26.871311    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"]
May 26 19:37:26.874508 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:37:26.874480    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24a3869d_c423_45a7_8d60_fd6e894ed81e.slice/crio-36959254073a65036da86f48dfcf16f4db5a4a7a2a29e650a509bf6536fe3f62 WatchSource:0}: Error finding container 36959254073a65036da86f48dfcf16f4db5a4a7a2a29e650a509bf6536fe3f62: Status 404 returned error can't find the container with id 36959254073a65036da86f48dfcf16f4db5a4a7a2a29e650a509bf6536fe3f62
May 26 19:37:27.066296 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:27.066219    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c" event={"ID":"24a3869d-c423-45a7-8d60-fd6e894ed81e","Type":"ContainerStarted","Data":"36959254073a65036da86f48dfcf16f4db5a4a7a2a29e650a509bf6536fe3f62"}
May 26 19:37:30.077778 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:30.077744    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c" event={"ID":"24a3869d-c423-45a7-8d60-fd6e894ed81e","Type":"ContainerStarted","Data":"c82eaf5ed3d59752cf2213880700b3bb1a3adbf97a2f9a4c12b6f7a55d2fac62"}
May 26 19:37:30.078188 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:30.077886    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:30.099418 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:30.099379    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c" podStartSLOduration=1.612289741 podStartE2EDuration="4.099367349s" podCreationTimestamp="2026-05-26 19:37:26 +0000 UTC" firstStartedPulling="2026-05-26 19:37:26.876917575 +0000 UTC m=+720.306495602" lastFinishedPulling="2026-05-26 19:37:29.363995178 +0000 UTC m=+722.793573210" observedRunningTime="2026-05-26 19:37:30.098290952 +0000 UTC m=+723.527869003" watchObservedRunningTime="2026-05-26 19:37:30.099367349 +0000 UTC m=+723.528945399"
May 26 19:37:33.098821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:33.098792    2576 scope.go:117] "RemoveContainer" containerID="691cbf08c8fb2ecc83361526a4254b3c8354e31787042359dcbc03e1d59bd1c1"
May 26 19:37:34.091198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:34.091161    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm" event={"ID":"6532d3cc-ab80-4964-b7d3-d079ab4a8c90","Type":"ContainerStarted","Data":"9e78b9eed679dd84b77a7c9ff621fbe59b35ba905416c1d588e4058b5ed07b51"}
May 26 19:37:34.091394 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:34.091376    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:41.082873 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:41.082839    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-zjk8c"
May 26 19:37:42.003304 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.003270    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"]
May 26 19:37:42.006389 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.006369    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.008818 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.008795    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
May 26 19:37:42.008943 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.008847    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mvplr\""
May 26 19:37:42.009088 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.009073    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
May 26 19:37:42.009305 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.009290    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
May 26 19:37:42.009354 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.009291    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 19:37:42.021566 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.021523    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"]
May 26 19:37:42.095311 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfq8j\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-kube-api-access-nfq8j\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a76a631-4387-451e-8394-9c3a315ab2de-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.095779 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.095570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.195990 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.195952    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a76a631-4387-451e-8394-9c3a315ab2de-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.195990 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.195988    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196218 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196041    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196218 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196089    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nfq8j\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-kube-api-access-nfq8j\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196218 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196141    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196218 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196164    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196218 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196196    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.196758 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.196727    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.198594 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.198573    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a76a631-4387-451e-8394-9c3a315ab2de-local-certs\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.198754 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.198734    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-cacerts\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.198966 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.198948    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.199003 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.198965    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6a76a631-4387-451e-8394-9c3a315ab2de-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.214623 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.214601    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-istio-token\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.216109 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.216087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfq8j\" (UniqueName: \"kubernetes.io/projected/6a76a631-4387-451e-8394-9c3a315ab2de-kube-api-access-nfq8j\") pod \"istiod-openshift-gateway-798958bb55-rd257\" (UID: \"6a76a631-4387-451e-8394-9c3a315ab2de\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.315705 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.315627    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:42.454496 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:42.454467    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"]
May 26 19:37:42.457803 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:37:42.457767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a76a631_4387_451e_8394_9c3a315ab2de.slice/crio-6452244b8ce80989805dbdb0eba59334479c546f188d37d19c143894ca022d9a WatchSource:0}: Error finding container 6452244b8ce80989805dbdb0eba59334479c546f188d37d19c143894ca022d9a: Status 404 returned error can't find the container with id 6452244b8ce80989805dbdb0eba59334479c546f188d37d19c143894ca022d9a
May 26 19:37:43.125755 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:43.125717    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257" event={"ID":"6a76a631-4387-451e-8394-9c3a315ab2de","Type":"ContainerStarted","Data":"6452244b8ce80989805dbdb0eba59334479c546f188d37d19c143894ca022d9a"}
May 26 19:37:44.840013 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:44.839976    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:37:44.840308 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:44.840040    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:37:45.096885 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.096804    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-858dbf95b8-rdskm"
May 26 19:37:45.135277 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.135236    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257" event={"ID":"6a76a631-4387-451e-8394-9c3a315ab2de","Type":"ContainerStarted","Data":"8a985d5c00cdec89c18cce0cfd221136d5ddb50bb029a00144b6fe1a116fbaed"}
May 26 19:37:45.135442 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.135397    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:45.136993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.136965    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-rd257 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 26 19:37:45.137121 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.137020    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257" podUID="6a76a631-4387-451e-8394-9c3a315ab2de" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:37:45.153150 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:45.153105    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257" podStartSLOduration=1.77307711 podStartE2EDuration="4.153094763s" podCreationTimestamp="2026-05-26 19:37:41 +0000 UTC" firstStartedPulling="2026-05-26 19:37:42.459757107 +0000 UTC m=+735.889335136" lastFinishedPulling="2026-05-26 19:37:44.839774758 +0000 UTC m=+738.269352789" observedRunningTime="2026-05-26 19:37:45.151386642 +0000 UTC m=+738.580964702" watchObservedRunningTime="2026-05-26 19:37:45.153094763 +0000 UTC m=+738.582672813"
May 26 19:37:46.140338 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:46.140258    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-rd257 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
May 26 19:37:46.140819 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:46.140356    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257" podUID="6a76a631-4387-451e-8394-9c3a315ab2de" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:37:49.140798 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:49.140768    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-rd257"
May 26 19:37:55.065094 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:37:55.065060    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-856948b99f-7w8s4"
May 26 19:38:54.420814 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.420783    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"]
May 26 19:38:54.422995 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.422977    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.425443 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.425422    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vplm6\""
May 26 19:38:54.425807 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.425789    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 19:38:54.425965 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.425947    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 19:38:54.439516 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.439493    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"]
May 26 19:38:54.469517 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.469490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fjzx\" (UniqueName: \"kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.469634 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.469525    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.569999 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.569971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2fjzx\" (UniqueName: \"kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.570121 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.570005    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.570325 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.570309    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.577373 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.577347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fjzx\" (UniqueName: \"kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.733117 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.733032    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:38:54.868180 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:54.868151    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"]
May 26 19:38:54.870788 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:38:54.870760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840abf56_d216_4afb_b638_9897fada2b8d.slice/crio-177a8da8cd173f83329c3c26406b744b85d424f1a432d283d20e2fca82ccf9b3 WatchSource:0}: Error finding container 177a8da8cd173f83329c3c26406b744b85d424f1a432d283d20e2fca82ccf9b3: Status 404 returned error can't find the container with id 177a8da8cd173f83329c3c26406b744b85d424f1a432d283d20e2fca82ccf9b3
May 26 19:38:55.360057 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:38:55.360021    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" event={"ID":"840abf56-d216-4afb-b638-9897fada2b8d","Type":"ContainerStarted","Data":"177a8da8cd173f83329c3c26406b744b85d424f1a432d283d20e2fca82ccf9b3"}
May 26 19:39:01.380852 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.380821    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" event={"ID":"840abf56-d216-4afb-b638-9897fada2b8d","Type":"ContainerStarted","Data":"1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15"}
May 26 19:39:01.381226 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.380913    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:39:01.399087 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.399028    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" podStartSLOduration=1.946527125 podStartE2EDuration="7.399009828s" podCreationTimestamp="2026-05-26 19:38:54 +0000 UTC" firstStartedPulling="2026-05-26 19:38:54.873202611 +0000 UTC m=+808.302780640" lastFinishedPulling="2026-05-26 19:39:00.325685312 +0000 UTC m=+813.755263343" observedRunningTime="2026-05-26 19:39:01.397121105 +0000 UTC m=+814.826699154" watchObservedRunningTime="2026-05-26 19:39:01.399009828 +0000 UTC m=+814.828587878"
May 26 19:39:01.553696 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.553661    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"]
May 26 19:39:01.556958 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.556940    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:01.559312 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.559292    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 26 19:39:01.559414 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.559309    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nh54j\""
May 26 19:39:01.566185 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.566161    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"]
May 26 19:39:01.629196 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.629163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tkfs\" (UniqueName: \"kubernetes.io/projected/799b7c43-3138-4b87-861c-ac5e32ab0672-kube-api-access-4tkfs\") pod \"dns-operator-controller-manager-648d5c98bc-qvmsj\" (UID: \"799b7c43-3138-4b87-861c-ac5e32ab0672\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:01.730638 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.730525    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4tkfs\" (UniqueName: \"kubernetes.io/projected/799b7c43-3138-4b87-861c-ac5e32ab0672-kube-api-access-4tkfs\") pod \"dns-operator-controller-manager-648d5c98bc-qvmsj\" (UID: \"799b7c43-3138-4b87-861c-ac5e32ab0672\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:01.744347 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.744322    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tkfs\" (UniqueName: \"kubernetes.io/projected/799b7c43-3138-4b87-861c-ac5e32ab0672-kube-api-access-4tkfs\") pod \"dns-operator-controller-manager-648d5c98bc-qvmsj\" (UID: \"799b7c43-3138-4b87-861c-ac5e32ab0672\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:01.867666 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.867639    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:01.995050 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:01.995023    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"]
May 26 19:39:01.997868 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:39:01.997838    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799b7c43_3138_4b87_861c_ac5e32ab0672.slice/crio-244d6b5647d4108ad74ff3ef14b5e55be0c3ae31f5436dc5b42de37b6f3fd0ae WatchSource:0}: Error finding container 244d6b5647d4108ad74ff3ef14b5e55be0c3ae31f5436dc5b42de37b6f3fd0ae: Status 404 returned error can't find the container with id 244d6b5647d4108ad74ff3ef14b5e55be0c3ae31f5436dc5b42de37b6f3fd0ae
May 26 19:39:02.385230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:02.385195    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj" event={"ID":"799b7c43-3138-4b87-861c-ac5e32ab0672","Type":"ContainerStarted","Data":"244d6b5647d4108ad74ff3ef14b5e55be0c3ae31f5436dc5b42de37b6f3fd0ae"}
May 26 19:39:05.398476 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:05.398442    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj" event={"ID":"799b7c43-3138-4b87-861c-ac5e32ab0672","Type":"ContainerStarted","Data":"38e4e64d335b60de3c2fcb557b432a24e23bb431386c9267e0afcd635b39e49f"}
May 26 19:39:05.398877 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:05.398562    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:05.414378 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:05.414329    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj" podStartSLOduration=1.942613593 podStartE2EDuration="4.414317774s" podCreationTimestamp="2026-05-26 19:39:01 +0000 UTC" firstStartedPulling="2026-05-26 19:39:01.999711079 +0000 UTC m=+815.429289111" lastFinishedPulling="2026-05-26 19:39:04.471415262 +0000 UTC m=+817.900993292" observedRunningTime="2026-05-26 19:39:05.414074706 +0000 UTC m=+818.843652757" watchObservedRunningTime="2026-05-26 19:39:05.414317774 +0000 UTC m=+818.843895824"
May 26 19:39:12.388108 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:12.388078    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:39:14.060638 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.060606    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"]
May 26 19:39:14.061003 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.060821    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" podUID="840abf56-d216-4afb-b638-9897fada2b8d" containerName="manager" containerID="cri-o://1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15" gracePeriod=2
May 26 19:39:14.068994 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.068966    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"]
May 26 19:39:14.084055 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.084034    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"]
May 26 19:39:14.084325 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.084313    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="840abf56-d216-4afb-b638-9897fada2b8d" containerName="manager"
May 26 19:39:14.084368 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.084327    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="840abf56-d216-4afb-b638-9897fada2b8d" containerName="manager"
May 26 19:39:14.084401 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.084383    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="840abf56-d216-4afb-b638-9897fada2b8d" containerName="manager"
May 26 19:39:14.087233 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.087211    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.104966 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.104939    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"]
May 26 19:39:14.106617 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.106598    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:14.109888 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.109869    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.126790 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.126752    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.128566 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.128525    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:14.129230 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.129203    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.163600 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.163569    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"]
May 26 19:39:14.163824 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:39:14.163803    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-56rl2], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-56rl2]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6" podUID="9d80f4c7-6eac-4c44-b3a4-2f425fd173b1"
May 26 19:39:14.241818 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.241720    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc9b5\" (UniqueName: \"kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.241818 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.241767    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56rl2\" (UniqueName: \"kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.242024 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.241824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.242024 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.241957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.294220 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.294198    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:39:14.296877 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.296850    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.342721 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.342652    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.342721 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.342693    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dc9b5\" (UniqueName: \"kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.342721 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.342712    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56rl2\" (UniqueName: \"kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.342956 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.342742    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.343061 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.343040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.347566 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.343368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.352024 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.352001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56rl2\" (UniqueName: \"kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-f2fs6\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.352118 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.352103    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc9b5\" (UniqueName: \"kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5\") pod \"kuadrant-operator-controller-manager-84b657d985-hnkrh\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.428998 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.428968    2576 generic.go:358] "Generic (PLEG): container finished" podID="840abf56-d216-4afb-b638-9897fada2b8d" containerID="1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15" exitCode=0
May 26 19:39:14.429166 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.429044    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk"
May 26 19:39:14.429166 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.429073    2576 scope.go:117] "RemoveContainer" containerID="1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15"
May 26 19:39:14.429269 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.429172    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.431200 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.431174    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.433021 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.432991    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.434209 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.434192    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:14.437498 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.437484    2576 scope.go:117] "RemoveContainer" containerID="1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15"
May 26 19:39:14.437640 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.437617    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:14.437766 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:39:14.437745    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15\": container with ID starting with 1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15 not found: ID does not exist" containerID="1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15"
May 26 19:39:14.437825 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.437777    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15"} err="failed to get container status \"1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15\": rpc error: code = NotFound desc = could not find container \"1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15\": container with ID starting with 1b8e84e6530ecac6021bb6d10340fd00e7595a3dbeb2fd490455e67c78cf1e15 not found: ID does not exist"
May 26 19:39:14.443369 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.443351    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fjzx\" (UniqueName: \"kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx\") pod \"840abf56-d216-4afb-b638-9897fada2b8d\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") "
May 26 19:39:14.443436 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.443398    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume\") pod \"840abf56-d216-4afb-b638-9897fada2b8d\" (UID: \"840abf56-d216-4afb-b638-9897fada2b8d\") "
May 26 19:39:14.443879 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.443859    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "840abf56-d216-4afb-b638-9897fada2b8d" (UID: "840abf56-d216-4afb-b638-9897fada2b8d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:39:14.445366 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.445346    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx" (OuterVolumeSpecName: "kube-api-access-2fjzx") pod "840abf56-d216-4afb-b638-9897fada2b8d" (UID: "840abf56-d216-4afb-b638-9897fada2b8d"). InnerVolumeSpecName "kube-api-access-2fjzx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:39:14.452505 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.452489    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:14.543771 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.543744    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume\") pod \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") "
May 26 19:39:14.543919 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.543792    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56rl2\" (UniqueName: \"kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2\") pod \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\" (UID: \"9d80f4c7-6eac-4c44-b3a4-2f425fd173b1\") "
May 26 19:39:14.543980 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.543968    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fjzx\" (UniqueName: \"kubernetes.io/projected/840abf56-d216-4afb-b638-9897fada2b8d-kube-api-access-2fjzx\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:14.544035 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.543986    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/840abf56-d216-4afb-b638-9897fada2b8d-extensions-socket-volume\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:14.544079 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.544034    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9d80f4c7-6eac-4c44-b3a4-2f425fd173b1" (UID: "9d80f4c7-6eac-4c44-b3a4-2f425fd173b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:39:14.546213 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.546183    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2" (OuterVolumeSpecName: "kube-api-access-56rl2") pod "9d80f4c7-6eac-4c44-b3a4-2f425fd173b1" (UID: "9d80f4c7-6eac-4c44-b3a4-2f425fd173b1"). InnerVolumeSpecName "kube-api-access-56rl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:39:14.586688 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.586658    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:14.590748 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:39:14.590722    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb56e6abb_c342_45cc_89e8_f2a33f44044d.slice/crio-83bda51c36380a5293a18597bcb1b133e03471e3f1ac05a8dcbbc45c54df1d4b WatchSource:0}: Error finding container 83bda51c36380a5293a18597bcb1b133e03471e3f1ac05a8dcbbc45c54df1d4b: Status 404 returned error can't find the container with id 83bda51c36380a5293a18597bcb1b133e03471e3f1ac05a8dcbbc45c54df1d4b
May 26 19:39:14.644371 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.644347    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-extensions-socket-volume\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:14.644460 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.644373    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56rl2\" (UniqueName: \"kubernetes.io/projected/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1-kube-api-access-56rl2\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:14.740383 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:14.740354    2576 status_manager.go:895] "Failed to get status for pod" podUID="840abf56-d216-4afb-b638-9897fada2b8d" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-kgmnk" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-kgmnk\" is forbidden: User \"system:node:ip-10-0-143-77.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-77.ec2.internal' and this object"
May 26 19:39:15.102862 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.102828    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="840abf56-d216-4afb-b638-9897fada2b8d" path="/var/lib/kubelet/pods/840abf56-d216-4afb-b638-9897fada2b8d/volumes"
May 26 19:39:15.434422 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.434387    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" event={"ID":"b56e6abb-c342-45cc-89e8-f2a33f44044d","Type":"ContainerStarted","Data":"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"}
May 26 19:39:15.434617 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.434433    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" event={"ID":"b56e6abb-c342-45cc-89e8-f2a33f44044d","Type":"ContainerStarted","Data":"83bda51c36380a5293a18597bcb1b133e03471e3f1ac05a8dcbbc45c54df1d4b"}
May 26 19:39:15.434617 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.434509    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:15.435462 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.435443    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"
May 26 19:39:15.458090 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.458042    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" podStartSLOduration=1.458030695 podStartE2EDuration="1.458030695s" podCreationTimestamp="2026-05-26 19:39:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:39:15.457139275 +0000 UTC m=+828.886717326" watchObservedRunningTime="2026-05-26 19:39:15.458030695 +0000 UTC m=+828.887608745"
May 26 19:39:15.487008 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.486982    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"]
May 26 19:39:15.499346 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:15.499320    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-f2fs6"]
May 26 19:39:16.403856 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:16.403823    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-qvmsj"
May 26 19:39:17.102483 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:17.102454    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d80f4c7-6eac-4c44-b3a4-2f425fd173b1" path="/var/lib/kubelet/pods/9d80f4c7-6eac-4c44-b3a4-2f425fd173b1/volumes"
May 26 19:39:26.440471 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:26.440440    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:30.103442 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.103413    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:30.103934 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.103707    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" podUID="b56e6abb-c342-45cc-89e8-f2a33f44044d" containerName="manager" containerID="cri-o://cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7" gracePeriod=10
May 26 19:39:30.360249 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.360197    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:30.471774 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.471726    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume\") pod \"b56e6abb-c342-45cc-89e8-f2a33f44044d\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") "
May 26 19:39:30.471949 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.471827    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc9b5\" (UniqueName: \"kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5\") pod \"b56e6abb-c342-45cc-89e8-f2a33f44044d\" (UID: \"b56e6abb-c342-45cc-89e8-f2a33f44044d\") "
May 26 19:39:30.472147 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.472126    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b56e6abb-c342-45cc-89e8-f2a33f44044d" (UID: "b56e6abb-c342-45cc-89e8-f2a33f44044d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:39:30.473916 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.473886    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5" (OuterVolumeSpecName: "kube-api-access-dc9b5") pod "b56e6abb-c342-45cc-89e8-f2a33f44044d" (UID: "b56e6abb-c342-45cc-89e8-f2a33f44044d"). InnerVolumeSpecName "kube-api-access-dc9b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:39:30.484343 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.484311    2576 generic.go:358] "Generic (PLEG): container finished" podID="b56e6abb-c342-45cc-89e8-f2a33f44044d" containerID="cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7" exitCode=0
May 26 19:39:30.484449 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.484401    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"
May 26 19:39:30.484485 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.484394    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" event={"ID":"b56e6abb-c342-45cc-89e8-f2a33f44044d","Type":"ContainerDied","Data":"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"}
May 26 19:39:30.484519 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.484502    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh" event={"ID":"b56e6abb-c342-45cc-89e8-f2a33f44044d","Type":"ContainerDied","Data":"83bda51c36380a5293a18597bcb1b133e03471e3f1ac05a8dcbbc45c54df1d4b"}
May 26 19:39:30.484573 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.484519    2576 scope.go:117] "RemoveContainer" containerID="cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"
May 26 19:39:30.492678 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.492659    2576 scope.go:117] "RemoveContainer" containerID="cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"
May 26 19:39:30.492923 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:39:30.492904    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7\": container with ID starting with cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7 not found: ID does not exist" containerID="cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"
May 26 19:39:30.492975 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.492933    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7"} err="failed to get container status \"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7\": rpc error: code = NotFound desc = could not find container \"cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7\": container with ID starting with cef0cf4ca6d6fd295c58a55023309101de44266a32fe09619b7824512ebc5be7 not found: ID does not exist"
May 26 19:39:30.507840 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.507816    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:30.514031 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.514003    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-hnkrh"]
May 26 19:39:30.573029 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.572991    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc9b5\" (UniqueName: \"kubernetes.io/projected/b56e6abb-c342-45cc-89e8-f2a33f44044d-kube-api-access-dc9b5\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:30.573029 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:30.573025    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b56e6abb-c342-45cc-89e8-f2a33f44044d-extensions-socket-volume\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:39:31.102742 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:31.102712    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b56e6abb-c342-45cc-89e8-f2a33f44044d" path="/var/lib/kubelet/pods/b56e6abb-c342-45cc-89e8-f2a33f44044d/volumes"
May 26 19:39:46.339029 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.338990    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"]
May 26 19:39:46.339420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.339329    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b56e6abb-c342-45cc-89e8-f2a33f44044d" containerName="manager"
May 26 19:39:46.339420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.339343    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b56e6abb-c342-45cc-89e8-f2a33f44044d" containerName="manager"
May 26 19:39:46.339420 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.339406    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="b56e6abb-c342-45cc-89e8-f2a33f44044d" containerName="manager"
May 26 19:39:46.342604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.342578    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.345037 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.345000    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rtm5p\""
May 26 19:39:46.353221 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.353193    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"]
May 26 19:39:46.386410 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386487    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386604 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5076641-4d33-4624-b0f2-15b354b17c6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.386822 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.386733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tps5b\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-kube-api-access-tps5b\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487795 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487751    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tps5b\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-kube-api-access-tps5b\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487829    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487873    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487898    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487928    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.487982 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.487959    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488259 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488012    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488259 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488034    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488259 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488067    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5076641-4d33-4624-b0f2-15b354b17c6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488417 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488267    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-credential-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488417 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488324    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-data\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488581 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488524    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-certs\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488666 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488636    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-workload-socket\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.488742 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.488724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5076641-4d33-4624-b0f2-15b354b17c6f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.490384 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.490364    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-envoy\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.490630 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.490607    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.495314 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.495287    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-istio-token\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.495739 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.495717    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tps5b\" (UniqueName: \"kubernetes.io/projected/d5076641-4d33-4624-b0f2-15b354b17c6f-kube-api-access-tps5b\") pod \"maas-default-gateway-openshift-default-7df95f575-mk565\" (UID: \"d5076641-4d33-4624-b0f2-15b354b17c6f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.657057 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.657022    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:46.788637 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:46.788613    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"]
May 26 19:39:46.790874 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:39:46.790844    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5076641_4d33_4624_b0f2_15b354b17c6f.slice/crio-2a90de16c4548d885f98c25a97147c7d41787ab4fbb1128803894943d7d52b74 WatchSource:0}: Error finding container 2a90de16c4548d885f98c25a97147c7d41787ab4fbb1128803894943d7d52b74: Status 404 returned error can't find the container with id 2a90de16c4548d885f98c25a97147c7d41787ab4fbb1128803894943d7d52b74
May 26 19:39:47.540452 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:47.540413    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565" event={"ID":"d5076641-4d33-4624-b0f2-15b354b17c6f","Type":"ContainerStarted","Data":"2a90de16c4548d885f98c25a97147c7d41787ab4fbb1128803894943d7d52b74"}
May 26 19:39:49.991924 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:49.991877    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:39:49.992299 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:49.991952    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:39:49.992299 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:49.991992    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:39:50.550834 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:50.550750    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565" event={"ID":"d5076641-4d33-4624-b0f2-15b354b17c6f","Type":"ContainerStarted","Data":"72c7b1704cb40787ab7231565b44f5b5c81a9e026c8ce42d0edf4c94c65797fd"}
May 26 19:39:50.571050 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:50.571006    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565" podStartSLOduration=1.372283407 podStartE2EDuration="4.570991352s" podCreationTimestamp="2026-05-26 19:39:46 +0000 UTC" firstStartedPulling="2026-05-26 19:39:46.792894395 +0000 UTC m=+860.222472439" lastFinishedPulling="2026-05-26 19:39:49.99160234 +0000 UTC m=+863.421180384" observedRunningTime="2026-05-26 19:39:50.56934282 +0000 UTC m=+863.998920873" watchObservedRunningTime="2026-05-26 19:39:50.570991352 +0000 UTC m=+864.000569403"
May 26 19:39:50.657875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:50.657832    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:51.015820 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.015789    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:39:51.019057 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.019038    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.021370 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.021345    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 26 19:39:51.021469 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.021448    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pb8hs\""
May 26 19:39:51.025240 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.025217    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:39:51.114325 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.114293    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:39:51.129882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.129838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.129882 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.129881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k627\" (UniqueName: \"kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.231051 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.231018    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.231051 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.231050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2k627\" (UniqueName: \"kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.231635 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.231616    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.239321 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.239291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k627\" (UniqueName: \"kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627\") pod \"limitador-limitador-7d549b5b-k6m7c\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") " pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.292823 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.292753    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:39:51.296066 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.296051    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.307130 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.307108    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:39:51.319965 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.319945    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:39:51.330098 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.330075    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:51.331984 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.331968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jrzm\" (UniqueName: \"kubernetes.io/projected/3955279d-524d-414e-8e2d-0d846ea59488-kube-api-access-8jrzm\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.332034 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.332012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3955279d-524d-414e-8e2d-0d846ea59488-config-file\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.433303 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.433273    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3955279d-524d-414e-8e2d-0d846ea59488-config-file\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.433445 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.433360    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jrzm\" (UniqueName: \"kubernetes.io/projected/3955279d-524d-414e-8e2d-0d846ea59488-kube-api-access-8jrzm\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.434165 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.434137    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3955279d-524d-414e-8e2d-0d846ea59488-config-file\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.442732 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.442713    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jrzm\" (UniqueName: \"kubernetes.io/projected/3955279d-524d-414e-8e2d-0d846ea59488-kube-api-access-8jrzm\") pod \"limitador-limitador-78c99df468-44vsj\" (UID: \"3955279d-524d-414e-8e2d-0d846ea59488\") " pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.451984 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.451952    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:39:51.454793 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:39:51.454773    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74981ec8_9a92_43d8_b0b7_252cf66f1887.slice/crio-51411cab880120e53427e6ab5f68a1b166e2d0d352b76ed7fdf6ea1853d83d2c WatchSource:0}: Error finding container 51411cab880120e53427e6ab5f68a1b166e2d0d352b76ed7fdf6ea1853d83d2c: Status 404 returned error can't find the container with id 51411cab880120e53427e6ab5f68a1b166e2d0d352b76ed7fdf6ea1853d83d2c
May 26 19:39:51.554863 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.554777    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" event={"ID":"74981ec8-9a92-43d8-b0b7-252cf66f1887","Type":"ContainerStarted","Data":"51411cab880120e53427e6ab5f68a1b166e2d0d352b76ed7fdf6ea1853d83d2c"}
May 26 19:39:51.607000 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.606970    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:51.663683 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.663657    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:51.729228 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:51.729200    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:39:51.732283 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:39:51.732264    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3955279d_524d_414e_8e2d_0d846ea59488.slice/crio-1659e4bcb1f2f8d7e57816c86969013fd4ebeaad2f8cf3d81b6d8be2fbd4667b WatchSource:0}: Error finding container 1659e4bcb1f2f8d7e57816c86969013fd4ebeaad2f8cf3d81b6d8be2fbd4667b: Status 404 returned error can't find the container with id 1659e4bcb1f2f8d7e57816c86969013fd4ebeaad2f8cf3d81b6d8be2fbd4667b
May 26 19:39:52.586873 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:52.586833    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj" event={"ID":"3955279d-524d-414e-8e2d-0d846ea59488","Type":"ContainerStarted","Data":"1659e4bcb1f2f8d7e57816c86969013fd4ebeaad2f8cf3d81b6d8be2fbd4667b"}
May 26 19:39:52.587454 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:52.587341    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:52.588342 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:52.588292    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7df95f575-mk565"
May 26 19:39:55.596875 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.596837    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" event={"ID":"74981ec8-9a92-43d8-b0b7-252cf66f1887","Type":"ContainerStarted","Data":"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"}
May 26 19:39:55.597334 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.596939    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:39:55.598146 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.598127    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj" event={"ID":"3955279d-524d-414e-8e2d-0d846ea59488","Type":"ContainerStarted","Data":"e419c43dfa42b8c332ed8a728e509afd185a75fba1ebebd4f3eae32eba8863e8"}
May 26 19:39:55.598288 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.598275    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:39:55.613376 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.613333    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" podStartSLOduration=2.497536691 podStartE2EDuration="5.613321229s" podCreationTimestamp="2026-05-26 19:39:50 +0000 UTC" firstStartedPulling="2026-05-26 19:39:51.45665668 +0000 UTC m=+864.886234708" lastFinishedPulling="2026-05-26 19:39:54.5724412 +0000 UTC m=+868.002019246" observedRunningTime="2026-05-26 19:39:55.612271067 +0000 UTC m=+869.041849117" watchObservedRunningTime="2026-05-26 19:39:55.613321229 +0000 UTC m=+869.042899278"
May 26 19:39:55.627942 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:39:55.627904    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj" podStartSLOduration=1.778008572 podStartE2EDuration="4.627892631s" podCreationTimestamp="2026-05-26 19:39:51 +0000 UTC" firstStartedPulling="2026-05-26 19:39:51.734046623 +0000 UTC m=+865.163624651" lastFinishedPulling="2026-05-26 19:39:54.583930667 +0000 UTC m=+868.013508710" observedRunningTime="2026-05-26 19:39:55.626341408 +0000 UTC m=+869.055919471" watchObservedRunningTime="2026-05-26 19:39:55.627892631 +0000 UTC m=+869.057470681"
May 26 19:40:06.603620 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:06.603521    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-44vsj"
May 26 19:40:06.604181 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:06.603737    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:40:06.664728 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:06.664699    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:40:06.665125 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:06.665096    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" podUID="74981ec8-9a92-43d8-b0b7-252cf66f1887" containerName="limitador" containerID="cri-o://4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3" gracePeriod=30
May 26 19:40:07.202707 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.202679    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:40:07.265455 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.265369    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2k627\" (UniqueName: \"kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627\") pod \"74981ec8-9a92-43d8-b0b7-252cf66f1887\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") "
May 26 19:40:07.265631 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.265485    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file\") pod \"74981ec8-9a92-43d8-b0b7-252cf66f1887\" (UID: \"74981ec8-9a92-43d8-b0b7-252cf66f1887\") "
May 26 19:40:07.265823 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.265799    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file" (OuterVolumeSpecName: "config-file") pod "74981ec8-9a92-43d8-b0b7-252cf66f1887" (UID: "74981ec8-9a92-43d8-b0b7-252cf66f1887"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:40:07.267570 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.267551    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627" (OuterVolumeSpecName: "kube-api-access-2k627") pod "74981ec8-9a92-43d8-b0b7-252cf66f1887" (UID: "74981ec8-9a92-43d8-b0b7-252cf66f1887"). InnerVolumeSpecName "kube-api-access-2k627". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:40:07.366589 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.366526    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74981ec8-9a92-43d8-b0b7-252cf66f1887-config-file\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:40:07.366589 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.366584    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k627\" (UniqueName: \"kubernetes.io/projected/74981ec8-9a92-43d8-b0b7-252cf66f1887-kube-api-access-2k627\") on node \"ip-10-0-143-77.ec2.internal\" DevicePath \"\""
May 26 19:40:07.639399 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.639367    2576 generic.go:358] "Generic (PLEG): container finished" podID="74981ec8-9a92-43d8-b0b7-252cf66f1887" containerID="4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3" exitCode=0
May 26 19:40:07.639794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.639428    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c"
May 26 19:40:07.639794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.639436    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" event={"ID":"74981ec8-9a92-43d8-b0b7-252cf66f1887","Type":"ContainerDied","Data":"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"}
May 26 19:40:07.639794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.639462    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-k6m7c" event={"ID":"74981ec8-9a92-43d8-b0b7-252cf66f1887","Type":"ContainerDied","Data":"51411cab880120e53427e6ab5f68a1b166e2d0d352b76ed7fdf6ea1853d83d2c"}
May 26 19:40:07.639794 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.639477    2576 scope.go:117] "RemoveContainer" containerID="4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"
May 26 19:40:07.647408 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.647388    2576 scope.go:117] "RemoveContainer" containerID="4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"
May 26 19:40:07.647691 ip-10-0-143-77 kubenswrapper[2576]: E0526 19:40:07.647671    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3\": container with ID starting with 4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3 not found: ID does not exist" containerID="4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"
May 26 19:40:07.647761 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.647700    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3"} err="failed to get container status \"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3\": rpc error: code = NotFound desc = could not find container \"4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3\": container with ID starting with 4274ddb5d4280bf1e7c0784ea9c2140a281c337739e0c2014d4997a3f607acc3 not found: ID does not exist"
May 26 19:40:07.659857 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.659724    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:40:07.661131 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:07.661110    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-k6m7c"]
May 26 19:40:09.102605 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:09.102567    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74981ec8-9a92-43d8-b0b7-252cf66f1887" path="/var/lib/kubelet/pods/74981ec8-9a92-43d8-b0b7-252cf66f1887/volumes"
May 26 19:40:27.095431 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:27.095402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:40:27.097497 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:27.097478    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:40:32.754039 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.754005    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-r65sk"]
May 26 19:40:32.754406 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.754314    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74981ec8-9a92-43d8-b0b7-252cf66f1887" containerName="limitador"
May 26 19:40:32.754406 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.754325    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="74981ec8-9a92-43d8-b0b7-252cf66f1887" containerName="limitador"
May 26 19:40:32.754406 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.754387    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="74981ec8-9a92-43d8-b0b7-252cf66f1887" containerName="limitador"
May 26 19:40:32.761474 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.761450    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk"
May 26 19:40:32.764199 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.764182    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
May 26 19:40:32.764985 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.764970    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
May 26 19:40:32.764985 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.764977    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-5rlzq\""
May 26 19:40:32.772320 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.772296    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-r65sk"]
May 26 19:40:32.781205 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.781177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg6sr\" (UniqueName: \"kubernetes.io/projected/d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70-kube-api-access-zg6sr\") pod \"keycloak-operator-7864d68cbd-r65sk\" (UID: \"d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70\") " pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk"
May 26 19:40:32.881996 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.881959    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zg6sr\" (UniqueName: \"kubernetes.io/projected/d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70-kube-api-access-zg6sr\") pod \"keycloak-operator-7864d68cbd-r65sk\" (UID: \"d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70\") " pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk"
May 26 19:40:32.890596 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:32.890572    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg6sr\" (UniqueName: \"kubernetes.io/projected/d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70-kube-api-access-zg6sr\") pod \"keycloak-operator-7864d68cbd-r65sk\" (UID: \"d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70\") " pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk"
May 26 19:40:33.072177 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:33.072092    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk"
May 26 19:40:33.197923 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:33.197820    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-r65sk"]
May 26 19:40:33.200799 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:40:33.200769    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47c0a10_fcc6_4d47_a0c4_c7f49ab31a70.slice/crio-298ac221024784943e5453f4b673da32d95bf247bef61a746ab1cc4b502eeb6c WatchSource:0}: Error finding container 298ac221024784943e5453f4b673da32d95bf247bef61a746ab1cc4b502eeb6c: Status 404 returned error can't find the container with id 298ac221024784943e5453f4b673da32d95bf247bef61a746ab1cc4b502eeb6c
May 26 19:40:33.724454 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:33.724415    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk" event={"ID":"d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70","Type":"ContainerStarted","Data":"298ac221024784943e5453f4b673da32d95bf247bef61a746ab1cc4b502eeb6c"}
May 26 19:40:40.754330 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:40.754292    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk" event={"ID":"d47c0a10-fcc6-4d47-a0c4-c7f49ab31a70","Type":"ContainerStarted","Data":"c442bec82204c36bec8cdbc9f23a454507f4241585fa3a2f0382ee491e764252"}
May 26 19:40:40.769574 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:40:40.769507    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-r65sk" podStartSLOduration=2.158265208 podStartE2EDuration="8.769490095s" podCreationTimestamp="2026-05-26 19:40:32 +0000 UTC" firstStartedPulling="2026-05-26 19:40:33.202651536 +0000 UTC m=+906.632229567" lastFinishedPulling="2026-05-26 19:40:39.81387642 +0000 UTC m=+913.243454454" observedRunningTime="2026-05-26 19:40:40.768289667 +0000 UTC m=+914.197867742" watchObservedRunningTime="2026-05-26 19:40:40.769490095 +0000 UTC m=+914.199068147"
May 26 19:41:56.983996 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:41:56.983960    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:42:54.397205 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:42:54.397169    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:43:03.876507 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.876467    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"]
May 26 19:43:03.878740 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.878725    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.881169 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.881149    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 19:43:03.882035 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.882016    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 19:43:03.882122 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.882033    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nrlxv\""
May 26 19:43:03.882122 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.882080    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 26 19:43:03.887127 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.887104    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"]
May 26 19:43:03.999570 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.999746 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999574    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563c9f8b-0661-4141-9a87-a1143127bf15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.999746 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtjwq\" (UniqueName: \"kubernetes.io/projected/563c9f8b-0661-4141-9a87-a1143127bf15-kube-api-access-vtjwq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.999746 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.999904 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:03.999904 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:03.999820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101182 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101147    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtjwq\" (UniqueName: \"kubernetes.io/projected/563c9f8b-0661-4141-9a87-a1143127bf15-kube-api-access-vtjwq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101182 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101183    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101427 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101206    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101427 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101241    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101427 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101300    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101427 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101332    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563c9f8b-0661-4141-9a87-a1143127bf15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101681 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101737 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101701    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.101778 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.101738    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.103565 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.103521    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563c9f8b-0661-4141-9a87-a1143127bf15-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.103904 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.103883    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563c9f8b-0661-4141-9a87-a1143127bf15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.108450 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.108425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtjwq\" (UniqueName: \"kubernetes.io/projected/563c9f8b-0661-4141-9a87-a1143127bf15-kube-api-access-vtjwq\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q\" (UID: \"563c9f8b-0661-4141-9a87-a1143127bf15\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.190109 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.190021    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:04.326610 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.326415    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"]
May 26 19:43:04.333832 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.333810    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:43:04.932605 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:04.932559    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:43:05.229041 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:05.228953    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q" event={"ID":"563c9f8b-0661-4141-9a87-a1143127bf15","Type":"ContainerStarted","Data":"7b2ca4f5932db82dd4efd296a70462b3a76a86ebf5775a9ba39f2641bdafba42"}
May 26 19:43:07.389391 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:07.389298    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:43:10.249744 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:10.249701    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q" event={"ID":"563c9f8b-0661-4141-9a87-a1143127bf15","Type":"ContainerStarted","Data":"498a2fdf14d7e1329acfc03ad958f928a85d5bd06b79cf576a96a4538ebf83c2"}
May 26 19:43:15.886997 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:15.886957    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:43:16.269315 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:16.269241    2576 generic.go:358] "Generic (PLEG): container finished" podID="563c9f8b-0661-4141-9a87-a1143127bf15" containerID="498a2fdf14d7e1329acfc03ad958f928a85d5bd06b79cf576a96a4538ebf83c2" exitCode=0
May 26 19:43:16.269315 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:16.269291    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q" event={"ID":"563c9f8b-0661-4141-9a87-a1143127bf15","Type":"ContainerDied","Data":"498a2fdf14d7e1329acfc03ad958f928a85d5bd06b79cf576a96a4538ebf83c2"}
May 26 19:43:18.277821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:18.277790    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q" event={"ID":"563c9f8b-0661-4141-9a87-a1143127bf15","Type":"ContainerStarted","Data":"c21f520fdb6b9742f0d9f134bd4059813c75df9cc6182dbb960974ae7743e6d6"}
May 26 19:43:18.278219 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:18.277993    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:43:18.295940 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:18.295887    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q" podStartSLOduration=2.233003025 podStartE2EDuration="15.29587271s" podCreationTimestamp="2026-05-26 19:43:03 +0000 UTC" firstStartedPulling="2026-05-26 19:43:04.333988602 +0000 UTC m=+1057.763566637" lastFinishedPulling="2026-05-26 19:43:17.396858292 +0000 UTC m=+1070.826436322" observedRunningTime="2026-05-26 19:43:18.294353187 +0000 UTC m=+1071.723931237" watchObservedRunningTime="2026-05-26 19:43:18.29587271 +0000 UTC m=+1071.725450759"
May 26 19:43:29.294089 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:43:29.294060    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q"
May 26 19:44:07.963848 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:07.963811    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"]
May 26 19:44:07.972019 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:07.971992    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:07.974523 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:07.974489    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 26 19:44:07.975651 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:07.975620    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"]
May 26 19:44:08.057809 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.057773    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.057968 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.057830    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.057968 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.057863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv2qg\" (UniqueName: \"kubernetes.io/projected/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kube-api-access-tv2qg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.058059 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.057990    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.058059 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.058020    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.058059 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.058045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159192 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159153    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159204    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159227    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159266    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159289    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159390 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159307    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv2qg\" (UniqueName: \"kubernetes.io/projected/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kube-api-access-tv2qg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159791 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159759    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159902 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159794    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.159902 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.159841    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.161611 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.161589    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.161781 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.161763    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.169587 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.169567    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv2qg\" (UniqueName: \"kubernetes.io/projected/4b702cd9-12fe-48a4-ae38-325ad4cf6ae0-kube-api-access-tv2qg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8\" (UID: \"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.283749 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.283663    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:08.422076 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.421995    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"]
May 26 19:44:08.425275 ip-10-0-143-77 kubenswrapper[2576]: W0526 19:44:08.425227    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b702cd9_12fe_48a4_ae38_325ad4cf6ae0.slice/crio-d932706ca072a6a68ffe63c5ed91942a9f231bdee5296c06515167b4e351de7b WatchSource:0}: Error finding container d932706ca072a6a68ffe63c5ed91942a9f231bdee5296c06515167b4e351de7b: Status 404 returned error can't find the container with id d932706ca072a6a68ffe63c5ed91942a9f231bdee5296c06515167b4e351de7b
May 26 19:44:08.441498 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:08.441468    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8" event={"ID":"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0","Type":"ContainerStarted","Data":"d932706ca072a6a68ffe63c5ed91942a9f231bdee5296c06515167b4e351de7b"}
May 26 19:44:09.446268 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:09.446230    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8" event={"ID":"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0","Type":"ContainerStarted","Data":"cb80d821c50057d84a7036acdfe3c5759231940b5ffecfa8d6b86af02d7dc03c"}
May 26 19:44:09.494647 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:09.494612    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:44:14.463033 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:14.462997    2576 generic.go:358] "Generic (PLEG): container finished" podID="4b702cd9-12fe-48a4-ae38-325ad4cf6ae0" containerID="cb80d821c50057d84a7036acdfe3c5759231940b5ffecfa8d6b86af02d7dc03c" exitCode=0
May 26 19:44:14.463491 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:14.463078    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8" event={"ID":"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0","Type":"ContainerDied","Data":"cb80d821c50057d84a7036acdfe3c5759231940b5ffecfa8d6b86af02d7dc03c"}
May 26 19:44:15.468745 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:15.468714    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8" event={"ID":"4b702cd9-12fe-48a4-ae38-325ad4cf6ae0","Type":"ContainerStarted","Data":"4a45462a193b3d408bd4ef87dbf2eeec419499eee0bd7508b8e46475b2863a33"}
May 26 19:44:15.469119 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:15.468924    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:15.484828 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:15.484752    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8" podStartSLOduration=8.213238729 podStartE2EDuration="8.484733361s" podCreationTimestamp="2026-05-26 19:44:07 +0000 UTC" firstStartedPulling="2026-05-26 19:44:14.463708167 +0000 UTC m=+1127.893286194" lastFinishedPulling="2026-05-26 19:44:14.735202784 +0000 UTC m=+1128.164780826" observedRunningTime="2026-05-26 19:44:15.484035524 +0000 UTC m=+1128.913613576" watchObservedRunningTime="2026-05-26 19:44:15.484733361 +0000 UTC m=+1128.914311424"
May 26 19:44:21.399007 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:21.398963    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:44:26.485947 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:26.485914    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8"
May 26 19:44:52.887204 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:44:52.887167    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:45:03.782607 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:03.782566    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:45:11.483821 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:11.483787    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:45:22.782799 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:22.782759    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:45:27.118151 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:27.118120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:45:27.120470 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:27.120449    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:45:30.892698 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:30.892665    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:45:42.091175 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:45:42.091138    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:46:13.388322 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:46:13.388240    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:46:19.284335 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:46:19.284302    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:46:56.281244 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:46:56.281215    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:47:11.980929 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:47:11.980894    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:47:50.383950 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:47:50.383916    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:48:07.881950 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:48:07.881909    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:48:22.088696 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:48:22.088660    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:48:38.281155 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:48:38.281124    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:49:07.397018 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:49:07.393277    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:49:11.780062 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:49:11.780025    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:49:34.085887 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:49:34.085848    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:49:44.082168 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:49:44.082133    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:50:00.179260 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:00.179228    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:50:08.087518 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:08.087484    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:50:25.414268 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:25.414233    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:50:27.139962 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:27.139928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:50:27.143509 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:27.143490    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:50:32.788660 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:50:32.788626    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:05.783114 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:05.783072    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:14.983866 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:14.983833    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:23.580653 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:23.580614    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:31.780221 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:31.780188    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:40.098014 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:40.097976    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:48.083869 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:48.083835    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:52.691106 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:52.691070    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:51:56.780253 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:51:56.780220    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:52:10.587934 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:52:10.587861    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:52:56.883925 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:52:56.883887    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:01.185728 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:01.185696    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:10.591795 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:10.591760    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:18.087552 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:18.087488    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:28.196711 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:28.196670    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:36.289236 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:36.289146    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:44.980891 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:44.980855    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:50.382328 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:50.382289    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:53:56.079570 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:53:56.079513    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:02.493187 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:02.493153    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:11.084590 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:11.084558    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:20.185049 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:20.185012    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:28.682901 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:28.682866    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:37.783854 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:37.783817    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:46.289993 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:46.289952    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:54:54.582602 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:54:54.582569    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:55:03.183198 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:55:03.183161    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:55:12.986809 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:55:12.986771    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:55:21.282711 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:55:21.282675    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:55:27.161618 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:55:27.161583    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:55:27.165950 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:55:27.165929    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 19:57:37.590335 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:57:37.590303    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:57:43.288002 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:57:43.287966    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:09.494852 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:09.494763    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:16.184053 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:16.184018    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:25.488926 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:25.488884    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:36.286814 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:36.286779    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:45.284240 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:45.284199    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:58:56.186801 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:58:56.186765    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:59:04.185371 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:59:04.185335    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:59:14.786899 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:59:14.786869    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:59:23.184145 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:59:23.184105    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:59:34.383134 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:59:34.383087    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 19:59:43.881805 ip-10-0-143-77 kubenswrapper[2576]: I0526 19:59:43.881768    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:00:15.787060 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:00:15.787023    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:00:27.184727 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:00:27.184698    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 20:00:27.190100 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:00:27.190078    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 20:00:58.991493 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:00:58.991460    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:07.284143 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:07.284054    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:16.691454 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:16.691413    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:24.682716 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:24.682679    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:33.791274 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:33.791243    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:47.184059 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:47.184020    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:01:55.290835 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:01:55.290797    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:03.680252 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:03.680214    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:11.791214 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:11.791176    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:20.088408 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:20.088376    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:27.991282 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:27.991248    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:37.982394 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:37.982350    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:02:56.989404 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:02:56.989368    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:04.786686 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:04.786653    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:13.784743 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:13.784705    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:22.186672 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:22.183665    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:39.784007 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:39.783973    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:47.587735 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:47.587694    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:03:56.783492 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:03:56.783457    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:04.783787 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:04.783737    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:13.386888 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:13.386804    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:22.494935 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:22.494897    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:31.781066 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:31.781025    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:45.082710 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:45.082676    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:04:54.124248 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:04:54.124213    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:04.690144 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:04.690112    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:13.486935 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:13.486895    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:22.085764 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:22.085724    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:27.213697 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:27.213669    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 20:05:27.217713 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:27.217691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 20:05:30.190616 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:30.190585    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:38.386746 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:38.386706    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:05:55.383915 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:05:55.383882    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:06:03.985233 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:06:03.985197    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:06:11.895301 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:06:11.895267    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:06:19.883914 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:06:19.883875    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:06:44.089602 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:06:44.089564    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:06:57.183188 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:06:57.183150    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-44vsj"]
May 26 20:07:07.096510 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:07.096434    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7w8s4_fc3d19a4-5021-4775-97f7-e273765f6e4c/manager/0.log"
May 26 20:07:07.683222 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:07.683193    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rdskm_6532d3cc-ab80-4964-b7d3-d079ab4a8c90/manager/2.log"
May 26 20:07:08.035937 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:08.035853    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-cxldc_252763e7-53f2-4ab7-a1de-86ab1a470ffc/manager/0.log"
May 26 20:07:09.676910 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:09.676886    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qvmsj_799b7c43-3138-4b87-861c-ac5e32ab0672/manager/0.log"
May 26 20:07:10.157198 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:10.157173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-44vsj_3955279d-524d-414e-8e2d-0d846ea59488/limitador/0.log"
May 26 20:07:10.747560 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:10.747518    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rd257_6a76a631-4387-451e-8394-9c3a315ab2de/discovery/0.log"
May 26 20:07:10.861933 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:10.861907    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cf57849b-cwf55_f2370c53-51ea-44f9-8f64-89de31b1cb1a/kube-auth-proxy/0.log"
May 26 20:07:11.087514 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:11.087424    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-mk565_d5076641-4d33-4624-b0f2-15b354b17c6f/istio-proxy/0.log"
May 26 20:07:11.672489 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:11.672461    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q_563c9f8b-0661-4141-9a87-a1143127bf15/storage-initializer/0.log"
May 26 20:07:11.679635 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:11.679615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-lxm5q_563c9f8b-0661-4141-9a87-a1143127bf15/main/0.log"
May 26 20:07:12.020712 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:12.020632    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8_4b702cd9-12fe-48a4-ae38-325ad4cf6ae0/storage-initializer/0.log"
May 26 20:07:12.027600 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:12.027567    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc7l2t8_4b702cd9-12fe-48a4-ae38-325ad4cf6ae0/main/0.log"
May 26 20:07:19.344370 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:19.344334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sm7r5_264b0107-4c8f-41a3-8b40-ec3500becd40/global-pull-secret-syncer/0.log"
May 26 20:07:19.427094 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:19.427064    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dqjc5_e9bde4a0-f16d-4cd0-ae23-84ccfcb07aa3/konnectivity-agent/0.log"
May 26 20:07:19.526125 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:19.526096    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-77.ec2.internal_757123ea7394d91dfada396cec4fd8f0/haproxy/0.log"
May 26 20:07:24.060122 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:24.060088    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-qvmsj_799b7c43-3138-4b87-861c-ac5e32ab0672/manager/0.log"
May 26 20:07:24.190744 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:24.190718    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-44vsj_3955279d-524d-414e-8e2d-0d846ea59488/limitador/0.log"
May 26 20:07:26.015004 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:26.014975    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/node-exporter/0.log"
May 26 20:07:26.032932 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:26.032909    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/kube-rbac-proxy/0.log"
May 26 20:07:26.053157 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:26.053139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fhmvw_f922eee1-8f66-419f-b350-0784ebdf4b47/init-textfile/0.log"
May 26 20:07:27.733595 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:27.733565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-cchcd_5bce422a-412b-4059-8819-cb18623ba19e/networking-console-plugin/0.log"
May 26 20:07:28.199308 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.199277    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"]
May 26 20:07:28.202650 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.202629    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.204679 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.204651    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"kube-root-ca.crt\""
May 26 20:07:28.204774 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.204656    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gpbg8\"/\"openshift-service-ca.crt\""
May 26 20:07:28.205410 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.205392    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gpbg8\"/\"default-dockercfg-bq52n\""
May 26 20:07:28.209021 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.209002    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"]
May 26 20:07:28.311378 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.311348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbv99\" (UniqueName: \"kubernetes.io/projected/72353b4d-e9be-42a3-a238-4f621af4f565-kube-api-access-gbv99\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.311588 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.311385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-lib-modules\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.311588 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.311406    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-proc\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.311588 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.311488    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-sys\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.311588 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.311557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-podres\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.412925 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.412883    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-sys\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.412939    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-podres\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413006    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbv99\" (UniqueName: \"kubernetes.io/projected/72353b4d-e9be-42a3-a238-4f621af4f565-kube-api-access-gbv99\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413009    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-sys\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413034    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-lib-modules\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413067    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-proc\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413123 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413124    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-lib-modules\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413355 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413146    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-proc\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.413355 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.413193    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/72353b4d-e9be-42a3-a238-4f621af4f565-podres\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.420481 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.420453    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbv99\" (UniqueName: \"kubernetes.io/projected/72353b4d-e9be-42a3-a238-4f621af4f565-kube-api-access-gbv99\") pod \"perf-node-gather-daemonset-2lzcc\" (UID: \"72353b4d-e9be-42a3-a238-4f621af4f565\") " pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.513758 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.513673    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:28.645247 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.645216    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"]
May 26 20:07:28.648225 ip-10-0-143-77 kubenswrapper[2576]: W0526 20:07:28.648195    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod72353b4d_e9be_42a3_a238_4f621af4f565.slice/crio-1c2258c9c45225c340d5ae0e295f2abb6a1bfbf16b0a12f85fc42c932c784647 WatchSource:0}: Error finding container 1c2258c9c45225c340d5ae0e295f2abb6a1bfbf16b0a12f85fc42c932c784647: Status 404 returned error can't find the container with id 1c2258c9c45225c340d5ae0e295f2abb6a1bfbf16b0a12f85fc42c932c784647
May 26 20:07:28.649737 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:28.649716    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:07:29.135526 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:29.135493    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc" event={"ID":"72353b4d-e9be-42a3-a238-4f621af4f565","Type":"ContainerStarted","Data":"3136c2bc48ec4e62508dab6a53ee495ee86617cb14d0abef0a5897f6eae55ac8"}
May 26 20:07:29.135938 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:29.135553    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc" event={"ID":"72353b4d-e9be-42a3-a238-4f621af4f565","Type":"ContainerStarted","Data":"1c2258c9c45225c340d5ae0e295f2abb6a1bfbf16b0a12f85fc42c932c784647"}
May 26 20:07:29.135938 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:29.135570    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:29.151174 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:29.151125    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc" podStartSLOduration=1.151111589 podStartE2EDuration="1.151111589s" podCreationTimestamp="2026-05-26 20:07:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:07:29.149133605 +0000 UTC m=+2522.578711646" watchObservedRunningTime="2026-05-26 20:07:29.151111589 +0000 UTC m=+2522.580689639"
May 26 20:07:30.119491 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:30.119459    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xf7v8_7d306ecf-acb7-4086-bada-412aabdec97d/dns/0.log"
May 26 20:07:30.136869 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:30.136842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xf7v8_7d306ecf-acb7-4086-bada-412aabdec97d/kube-rbac-proxy/0.log"
May 26 20:07:30.205156 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:30.205130    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rsvbh_73bfe9d1-d934-4450-8d01-2c074d6d307b/dns-node-resolver/0.log"
May 26 20:07:30.713887 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:30.713860    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8452_9f1a8f1e-67b3-46ab-83b1-734f37eff620/node-ca/0.log"
May 26 20:07:31.580284 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:31.580255    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-rd257_6a76a631-4387-451e-8394-9c3a315ab2de/discovery/0.log"
May 26 20:07:31.597898 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:31.597875    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59cf57849b-cwf55_f2370c53-51ea-44f9-8f64-89de31b1cb1a/kube-auth-proxy/0.log"
May 26 20:07:31.676703 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:31.676671    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7df95f575-mk565_d5076641-4d33-4624-b0f2-15b354b17c6f/istio-proxy/0.log"
May 26 20:07:32.298879 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:32.298848    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ssq2v_2453915b-ca88-440b-8f04-82378382f88d/serve-healthcheck-canary/0.log"
May 26 20:07:32.847813 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:32.847788    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x978b_971a2561-3b75-47c2-afa4-0cc832cd708d/kube-rbac-proxy/0.log"
May 26 20:07:32.871213 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:32.871189    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x978b_971a2561-3b75-47c2-afa4-0cc832cd708d/exporter/0.log"
May 26 20:07:32.893135 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:32.893115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x978b_971a2561-3b75-47c2-afa4-0cc832cd708d/extractor/0.log"
May 26 20:07:34.770423 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:34.770392    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-856948b99f-7w8s4_fc3d19a4-5021-4775-97f7-e273765f6e4c/manager/0.log"
May 26 20:07:34.946893 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:34.946867    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rdskm_6532d3cc-ab80-4964-b7d3-d079ab4a8c90/manager/1.log"
May 26 20:07:34.959115 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:34.959093    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-858dbf95b8-rdskm_6532d3cc-ab80-4964-b7d3-d079ab4a8c90/manager/2.log"
May 26 20:07:35.049683 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:35.049596    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-94b8b45bb-cxldc_252763e7-53f2-4ab7-a1de-86ab1a470ffc/manager/0.log"
May 26 20:07:35.148686 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:35.148655    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gpbg8/perf-node-gather-daemonset-2lzcc"
May 26 20:07:36.340847 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:36.340819    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-psbcn_cd2b6d81-e31d-4eec-b382-ff7fd0cbbb28/openshift-lws-operator/0.log"
May 26 20:07:42.234793 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.234763    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/kube-multus-additional-cni-plugins/0.log"
May 26 20:07:42.253949 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.253922    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/egress-router-binary-copy/0.log"
May 26 20:07:42.272051 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.272030    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/cni-plugins/0.log"
May 26 20:07:42.289335 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.289314    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/bond-cni-plugin/0.log"
May 26 20:07:42.308801 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.308783    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/routeoverride-cni/0.log"
May 26 20:07:42.326092 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.326065    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/whereabouts-cni-bincopy/0.log"
May 26 20:07:42.344572 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.344556    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tj5wx_1f50beb4-cbef-4380-9e29-5e36b07bae3e/whereabouts-cni/0.log"
May 26 20:07:42.527921 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.527840    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w5q56_290c7486-09e8-482e-9a46-9f8d717645d0/kube-multus/0.log"
May 26 20:07:42.607258 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.607229    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbzzm_cceaa09b-1667-44ab-8040-c817956ce806/network-metrics-daemon/0.log"
May 26 20:07:42.623267 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:42.623248    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qbzzm_cceaa09b-1667-44ab-8040-c817956ce806/kube-rbac-proxy/0.log"
May 26 20:07:43.963655 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:43.963627    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-controller/0.log"
May 26 20:07:43.979045 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:43.979022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/0.log"
May 26 20:07:43.989733 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:43.989708    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovn-acl-logging/1.log"
May 26 20:07:44.005911 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.005893    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/kube-rbac-proxy-node/0.log"
May 26 20:07:44.022772 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.022752    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/kube-rbac-proxy-ovn-metrics/0.log"
May 26 20:07:44.039467 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.039442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/northd/0.log"
May 26 20:07:44.056464 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.056440    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/nbdb/0.log"
May 26 20:07:44.074384 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.074365    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/sbdb/0.log"
May 26 20:07:44.164174 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:44.164140    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-shbc8_be6699f4-6705-4491-9ab4-da6905a6e96a/ovnkube-controller/0.log"
May 26 20:07:45.237166 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:45.237136    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-x4mb5_1398705e-a375-4623-99c0-a54eef05a07f/check-endpoints/0.log"
May 26 20:07:45.303683 ip-10-0-143-77 kubenswrapper[2576]: I0526 20:07:45.303654    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-th4nh_986f5da4-9255-4cbc-9457-c5af708772e2/network-check-target-container/0.log"